-- Logs begin at Thu 2022-09-01 17:10:37 UTC, end at Thu 2022-09-01 18:35:35 UTC. -- Sep 01 17:55:14.082956 dv-cinder-749155-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 17:55:14.092608 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 17:55:14 2022] *** Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: nodename: dv-cinder-749155-10-iscsi Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: machine: x86_64 Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: clock source: unix Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: pcre jit disabled Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: detected number of CPU cores: 4 Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: current working directory: / Sep 01 17:55:14.094581 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: detected binary path: /usr/bin/uwsgi-core Sep 01 17:55:14.095326 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: your processes number limit is 47680 Sep 01 17:55:14.095326 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: your memory page size is 4096 bytes Sep 01 17:55:14.095326 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: detected max file descriptor number: 2048 Sep 01 17:55:14.095326 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: lock engine: pthread robust mutexes Sep 01 17:55:14.095326 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: thunder lock: enabled Sep 01 17:55:14.095326 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 17:55:14.095326 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 17:55:14.134168 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: Python main interpreter initialized at 0x556af9a739c0 Sep 01 17:55:14.134168 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: python threads support enabled Sep 01 17:55:14.134168 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: your server socket listen backlog is limited to 100 connections Sep 01 17:55:14.134168 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: your mercy for graceful operations on workers is 90 seconds Sep 01 17:55:14.134505 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 17:55:14.134584 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: *** Operational MODE: preforking *** Sep 01 17:55:14.134829 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: *** uWSGI is running in multiple interpreter mode *** Sep 01 17:55:14.134829 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: spawned uWSGI master process (pid: 106190) Sep 01 17:55:14.135016 dv-cinder-749155-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 17:55:14.135853 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: spawned uWSGI worker 1 (pid: 106191, cores: 1) Sep 01 17:55:14.135989 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: spawned uWSGI worker 2 (pid: 106192, cores: 1) Sep 01 17:55:14.136113 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 17:55:14.806068 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:55:14.806668 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 17:55:15.889354 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:55:15.889354 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: from cryptography.utils import int_from_bytes Sep 01 17:55:15.890085 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:55:15.890085 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: from cryptography.utils import int_from_bytes Sep 01 17:55:15.896593 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:55:15.896593 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: from cryptography.utils import int_from_bytes Sep 01 17:55:15.897019 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 17:55:15.897019 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: from cryptography.utils import int_from_bytes Sep 01 17:55:18.366269 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:55:18.367396 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:55:18.367662 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:55:18.367932 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 17:55:18.368293 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:55:18.368446 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 17:55:18.368538 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:55:18.368632 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 17:55:18.368714 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.368998 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 17:55:18.369086 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.369256 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 17:55:18.369343 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.369635 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.369722 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.369964 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.370051 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.370277 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.370376 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.370603 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.370699 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.370929 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.371014 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.371240 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.371331 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.371514 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.371606 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.371836 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.371945 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.372168 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-10-iscsi {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.372283 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.372469 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.372588 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.372792 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.372900 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.373124 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-10-iscsi {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.373211 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.373449 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.373535 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.373759 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.373853 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.374075 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.374161 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.374394 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.374488 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.374706 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.374913 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.375309 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.375309 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.375544 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.375651 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.375823 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.375949 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.376158 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.376302 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.376463 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.376611 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.376773 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.376907 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.377113 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.377245 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.377429 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.377562 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.377739 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.377865 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.378060 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.378187 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.378372 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.378528 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-10-iscsi {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.378697 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.378848 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.379009 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.379149 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.379405 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-10-iscsi {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.379531 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.379720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.379854 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.380034 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.380162 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.380372 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.380525 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.380789 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.380924 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.381103 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.381231 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.381414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.381550 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.381738 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.381865 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.382062 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.382209 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.383224 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.383362 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.383504 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.383635 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.383759 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.383881 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384013 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384137 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384260 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384401 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384537 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384661 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384846 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.384980 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.385157 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.385283 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.385418 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.385565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.385705 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.385878 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.386007 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.386189 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.386324 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.386457 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.386642 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.386773 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.386896 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.387054 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.387180 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.387381 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.387515 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.387708 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.387856 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.387982 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.388119 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.388243 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.388393 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.388540 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.388669 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.388868 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.389012 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.389181 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.389307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.389492 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.389627 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.389806 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.389933 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.390117 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.390257 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.390428 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.390562 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.390740 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.390867 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.391051 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.391177 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.391360 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.391485 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.391679 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.391805 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.391998 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.392130 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.392332 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.392545 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.392684 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.392811 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.392959 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.393084 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.393279 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.393413 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.393591 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.393717 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.393900 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.394025 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.394225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.394362 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.394536 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.394663 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.394845 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.394972 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.395155 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.395293 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.395476 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.395602 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.395784 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.395909 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.396094 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.396234 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.396376 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.396512 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.396643 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.396766 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.396951 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.397086 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.397272 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.397399 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.397831 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.398007 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.398202 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.398331 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.398542 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.398666 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.398911 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.399038 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.399223 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.399350 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.399537 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.399669 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.399846 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.399972 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.400156 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.400283 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.400479 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.400604 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.400791 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.400917 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.401097 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.401225 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.401405 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.401531 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.401713 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.401849 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.402020 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.402146 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.402325 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.402449 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.402641 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.402785 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.402947 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.403045 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.403252 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.403348 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.403556 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.403658 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.403863 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.403949 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.404176 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.404261 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.404504 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.404602 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.404814 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.404919 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.405128 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.405222 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.405433 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.405529 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.405740 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.405826 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.406046 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.406139 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.406353 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.406457 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.406661 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.406773 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.406962 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.407063 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.407266 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.407360 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.407574 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.407660 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.407881 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.407972 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.408193 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.408286 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.408521 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.408606 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.408822 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.408916 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.409127 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.409214 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.409431 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.409517 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.409736 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.409821 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.410031 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.410114 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.410336 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.410437 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.410635 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.410730 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.410937 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.411030 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.411242 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.411370 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.411547 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.411638 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.411848 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.411935 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.412151 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.412234 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.412501 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.412669 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.412889 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.413019 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.413145 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.413276 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.413401 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.413532 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.413787 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 17:55:18.413925 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.414130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.414258 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.414468 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.414607 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.414827 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.414984 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.415131 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.415257 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.415450 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.415577 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.415782 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.415918 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.416099 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.416226 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.416436 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.416578 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.416752 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.416899 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.417075 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.417202 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.417388 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.417514 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.417702 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.417850 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.418015 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.418143 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.418337 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.418472 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.418656 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.418787 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.418968 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.419101 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.419289 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.419425 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.419604 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.419724 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.419926 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.420054 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.420240 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.420384 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.420587 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.420712 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.420920 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.421060 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.421242 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.421368 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.421554 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.421687 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.421877 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.422012 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.422193 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.422319 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.422503 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.422640 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.422814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.423029 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.423199 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.423336 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.423461 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.423584 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.423756 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.423893 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.424066 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.424199 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.424401 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.424529 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.424732 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.424872 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.425050 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.425190 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.425363 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.425490 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.425677 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.425806 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.425987 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.426121 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.426299 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.426426 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.426610 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.426737 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.426928 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.427047 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.427243 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.427379 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.427558 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.427692 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.427872 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.428005 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.428199 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.428351 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.428537 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.428663 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.428853 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.428979 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.429167 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.429803 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.429988 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.430116 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.430299 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.430426 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.430606 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.430742 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.430916 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.431051 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.431222 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.431355 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.431530 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.431664 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.431839 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.431968 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.432154 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.432280 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.432512 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.432648 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.432823 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.432957 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.433159 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.433286 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.433434 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.433640 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.433767 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.433898 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.434023 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.434154 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.434341 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.434469 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.434655 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.434783 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.434962 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.435096 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.435287 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.435414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.435601 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.435727 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.435907 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.436034 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.436212 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.436391 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.436551 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.436689 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.436861 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.436988 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.437167 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.437294 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.437477 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.437602 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.437790 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.437924 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.438101 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.438228 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.438410 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.438545 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.438723 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.438858 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.439037 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.439164 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.439348 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.439472 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.439659 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.439793 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.439986 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.440122 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.440297 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.440462 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.440634 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.440761 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.440960 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.441086 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.441278 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.441406 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.441583 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.441715 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.441892 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.442025 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.442199 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.442326 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.442504 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.442632 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.442810 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.442937 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.443119 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.443320 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.443457 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.443581 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.443704 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.443836 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.444004 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.444146 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.444342 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.444473 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.444637 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.444776 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.445505 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.445665 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.445817 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.445945 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.446145 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.446291 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.446417 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.446554 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.446722 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.446850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.447029 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.447155 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.447336 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.447481 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.447643 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.447782 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.447950 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.448077 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.448296 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.448449 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.448626 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.448761 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.448973 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.449116 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.449273 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.449403 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.449585 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.449713 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.449903 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.450028 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.450218 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.450350 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.450528 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.450661 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.450839 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.450964 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.451151 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.451277 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.451467 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.451593 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.451778 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.451904 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.452098 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.452231 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.452432 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.452559 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.452754 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.452881 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.453059 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.453195 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.453381 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.453500 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.453694 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.453803 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.454017 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.454114 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.454326 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.454423 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.454644 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.454753 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.454955 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.455048 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.455272 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.455368 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.455827 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456220 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456292 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456400 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456480 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456559 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456650 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456732 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456811 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.456889 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.457121 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.457218 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.457443 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.457551 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.457754 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.457842 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.458075 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.458161 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.458384 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.458470 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.458703 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.458789 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.459007 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.459091 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.459322 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.459409 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.459633 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.459724 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.459954 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.460048 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.460262 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.460370 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.460639 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.460925 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.461013 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.461264 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.461350 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.461578 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.461663 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.461895 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.461989 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.462205 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.462292 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.462515 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.462600 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.462902 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.463001 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.463160 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.463249 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.463449 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.463532 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.463760 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.463846 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.464069 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.464156 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.464406 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.464495 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.464719 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.464816 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.465027 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.465118 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.465332 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.465424 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.465644 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.465737 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.465962 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.466057 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.466274 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.466366 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.466580 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.466673 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.466887 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.466979 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.467203 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.467291 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.467509 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.467614 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.467830 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.467923 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.468140 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.468226 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.468476 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.468565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.468785 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.468871 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.469094 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.469182 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.469419 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.469504 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.469733 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.469819 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.470038 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.470130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.470344 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.470430 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.470652 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.470745 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.470961 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.471047 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.471277 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.471372 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.471589 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.471682 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.471899 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.472000 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.472217 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.472304 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.472556 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.472659 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.472866 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.472976 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.473182 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.473277 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.473491 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.473576 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.473804 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.473899 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.474117 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.474204 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.474427 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.474511 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.474739 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.474836 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.475052 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.475137 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.475361 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.475451 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.475666 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.475759 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.475978 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.476063 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.476354 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.476479 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.476801 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.476927 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.477117 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.477264 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.477426 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.477588 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.477745 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.477906 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.478065 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.478257 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.478586 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.478681 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.478919 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.479019 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.479250 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.479335 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.479565 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.479649 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.479874 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.479968 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.480186 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.480282 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.480518 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.480607 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.480828 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.480913 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.481141 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.481235 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.481450 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.481551 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.481757 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.481843 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.482064 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.482157 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.482368 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.482459 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.482672 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.482764 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.482976 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.483058 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.483281 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.483378 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.483584 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.483677 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.483898 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.483985 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.484201 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.484293 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.484540 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.484636 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.484844 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.484930 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.485154 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.485240 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.485468 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.485561 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.485773 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.485865 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.486081 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.486166 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.486387 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.486479 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.486713 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.486798 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.487026 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.487113 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.487337 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.487425 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.487656 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.487747 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.487951 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.488037 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.488301 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.488439 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.488633 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.488728 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.488959 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.489052 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.489267 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.489355 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.489574 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.489659 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.489897 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.489990 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.490195 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.490289 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.490505 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.490591 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.490812 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.490906 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.491118 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.491203 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.491427 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.491512 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.492252 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.492379 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.492592 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.492674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.492918 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.493006 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.493206 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.493316 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.493522 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.493620 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.493834 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.493921 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.494146 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.494234 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.494452 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.494537 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.494758 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.494842 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.495062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.495147 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.495369 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.495453 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.495676 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.495763 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.495987 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.496073 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.496291 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.496395 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.496627 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.496712 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.496934 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.497020 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.497237 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.497329 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.497542 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.497636 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.497845 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.497935 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.498154 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.498240 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.498457 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.498550 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.498764 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.498849 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.499067 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.499152 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.499377 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.499471 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.499685 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.499771 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.499991 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.500076 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.500296 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.500421 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.500624 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.500711 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.500933 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.501024 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.501240 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.501328 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.501551 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.501645 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.501856 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.501948 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.502160 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.502245 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.502466 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.502550 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.502774 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.502901 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.503080 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.503168 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.503383 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.503476 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.503686 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.503771 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.503990 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.504083 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.504293 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.504410 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.504622 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.504721 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.504927 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.505013 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.505229 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.505325 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.505533 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.505627 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.505842 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.505935 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.506147 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.506229 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.506449 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.506543 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.506773 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.506867 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.507084 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.507170 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.507436 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.508210 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.508301 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.508491 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.508593 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.508675 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.508913 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.509002 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.509221 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.509306 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.509535 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.509627 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.509856 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.509952 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.510168 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.510254 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.510491 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.510576 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.510804 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.510889 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.511119 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.511206 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.511424 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.511510 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.511731 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.511824 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.512051 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.512136 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.512386 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.512474 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.512703 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.512791 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.513012 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.513097 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.513323 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.513418 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.513649 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.513748 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.513953 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.514050 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.514266 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.514361 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.514581 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.514667 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.514892 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.515036 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.515206 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.515302 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.515517 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.515609 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.515826 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.515919 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.516141 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.516240 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.516473 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.516572 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.516787 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.516873 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.517096 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.517184 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.517405 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.517499 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.517717 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.517803 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.518026 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.518125 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.518333 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.518421 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.518641 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.518734 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.518952 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.519039 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.519255 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.519341 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.519564 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.519650 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.519870 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.519956 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.520178 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.520263 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.520506 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.520606 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.520829 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.520917 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.521140 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.521234 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.521450 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.521544 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.521766 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.521853 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.522074 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.522160 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.522430 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.522774 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.523028 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.523159 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.523349 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.523466 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.523654 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.523839 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.524071 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.524159 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.524414 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.524505 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.524730 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.524819 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.525067 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.525165 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.525376 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.525462 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.525683 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.525810 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.525997 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.526128 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.526324 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.526446 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.526633 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.526762 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.526938 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.527071 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.527244 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.527378 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.527567 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.527692 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.527875 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.528021 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.528199 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.528345 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.528645 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.528731 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.528955 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.529043 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.529261 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.529360 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.529578 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.529662 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.529901 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.529987 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.530276 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.530369 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.530602 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.530731 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.530921 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.531007 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.531243 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.531342 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.531551 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.531646 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.531868 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.531955 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.532179 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.532266 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.532530 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.532631 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.532856 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.532943 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.533170 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.533266 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.533487 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.533581 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.533794 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.533881 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.534119 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.534206 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.534447 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.534536 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.534765 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.534852 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.535083 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.535170 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.535393 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.535481 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.535725 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.535812 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.536051 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.536137 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.536391 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.536495 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.536724 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.536822 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.537058 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.537153 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.537366 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.537454 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.537680 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.537766 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.537987 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.538082 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.538294 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.538381 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.538652 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.538812 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.538968 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.539283 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.539370 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.539597 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.539684 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.539908 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.539994 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.540212 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.540300 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.540542 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.540639 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.540867 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.540967 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.541173 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.541259 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.541496 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.541589 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.541815 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.541908 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.542126 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.542220 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.542435 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.542521 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.542740 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.542839 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.543056 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.543149 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.543366 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.543451 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.543674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.543769 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.543980 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.544068 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.544285 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.544461 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.544632 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.544732 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.544944 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.545029 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.545258 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.545344 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.545567 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.545655 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.545883 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.545970 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.546191 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.546287 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.546529 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.546616 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.546836 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.546929 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.547160 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.547255 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.547479 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.547573 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.547808 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.547901 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.548117 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.548211 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.548456 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.548559 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.548771 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.548857 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.549085 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.549184 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.549393 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.549480 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.549701 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.549795 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.550013 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.550107 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.550315 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.550401 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.550619 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.550705 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.550923 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.551023 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.551232 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.551319 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.551538 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.551674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.551849 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.551938 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.552155 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.552244 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.552484 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.552572 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.552789 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.552876 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.553091 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.553215 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.553406 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.553491 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.553729 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.553816 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.554038 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.554132 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.554880 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.555004 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.555258 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.555359 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.555612 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.555711 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.555934 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.556033 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.556254 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.556359 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.556599 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.556686 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.556912 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.557010 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.557231 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.557316 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.557549 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.557634 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.557859 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.557992 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.558176 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.558261 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.558493 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.558578 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.558809 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.558906 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.559129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.559330 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.559446 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.559668 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.559764 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.559986 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.560080 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.560301 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.560432 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.560638 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.560740 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.560955 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.561211 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.561301 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.561548 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.561638 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.561868 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.561965 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.562180 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.562267 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.562491 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.562587 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.562805 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.562898 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.563122 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.563209 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.563438 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.563537 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.563753 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.563840 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.564067 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.564154 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.564403 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.564507 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.564724 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.564811 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.565041 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.565134 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.565367 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.565462 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.565704 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.565790 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.566015 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.566101 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.566333 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.566421 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.566648 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.566733 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.566964 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.567057 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.567281 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.567368 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.567597 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.567683 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.567916 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.568011 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.568229 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.568335 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.568566 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.568653 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.568881 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.568977 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.569199 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.569291 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.569514 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.569600 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.569851 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.570494 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.570690 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.570822 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.571006 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.571103 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.571321 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.571410 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.571637 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.571723 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.571949 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.572044 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.572275 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.572494 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.572638 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.572817 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.572962 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.573156 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.573278 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.573485 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.573599 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.573814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.573922 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.574136 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.574444 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.574532 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.574764 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.574850 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.575072 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.575174 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.575383 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.575470 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.575696 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.575784 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.576008 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.576104 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.576332 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.576433 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.576665 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.576758 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.576980 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.577074 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.577285 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.577371 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.577598 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.577684 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.577908 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.578002 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.578211 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.578445 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.578533 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.578795 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.578890 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.579116 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.579244 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.579435 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.579521 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.579747 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.579841 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.580075 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.580277 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.580407 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.580647 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.580750 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.580966 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.581060 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.581294 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.581380 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.581621 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.581716 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.581932 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.582018 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.582237 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.582328 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.582542 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.582637 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.582856 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.582940 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.583165 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.583263 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.583472 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.583558 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.583785 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.583877 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.584092 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.584179 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.584420 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.584511 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.584735 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.584830 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.585043 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.585174 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.585347 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.585443 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.585683 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.585771 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.585997 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.586159 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.586326 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.586476 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.586633 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.586785 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.586942 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.587094 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.587248 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.587410 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.587563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.587718 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.587871 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.588031 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.588178 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.588363 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.588510 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.588681 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.588817 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.588990 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.589129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.589350 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.589449 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.589665 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.589752 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.589994 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.590089 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.590302 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.590390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.590610 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.590705 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.590930 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.591017 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.591243 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.591329 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.591569 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.591665 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.591875 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.591961 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.592184 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.592271 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.592527 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.592627 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.592842 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.592929 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.593168 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.593387 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.593481 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.593724 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.593812 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.594051 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.594137 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.594389 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.594484 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.594725 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.594950 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.595036 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.595287 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.595381 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.595611 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.595698 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.595939 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.596026 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.596256 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.596382 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.596595 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.596683 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.596911 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.596998 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.597221 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.597306 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.597530 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.597617 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.597840 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.597935 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.598151 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.598244 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.598459 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.598545 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.598769 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.598854 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.599075 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.599168 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.599385 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.599470 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.599693 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.599779 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.600001 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.600095 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.600323 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.600413 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.600644 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.600740 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.600957 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.601045 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.601845 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.601945 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.602158 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.602376 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.602473 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.602701 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.602790 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.603026 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.603113 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.603342 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.603503 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.603656 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.603743 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.603969 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.604062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.604282 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.604447 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.604623 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.604710 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.604953 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.605037 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.605267 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.605364 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.605572 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.605667 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.605887 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.605973 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.606218 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.606307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.606539 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.606626 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.606847 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.606941 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.607203 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.607289 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.607528 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.607621 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.607850 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.607946 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.608163 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.608249 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.608512 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.608599 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.608824 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.608921 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.609146 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.609232 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.609458 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.609600 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.609781 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.609876 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.610091 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.610178 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.610409 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.610495 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.610716 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.610804 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.611022 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.611108 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.611330 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.611424 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.611650 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.611776 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.611956 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.612044 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.612258 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.612377 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.612588 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.612677 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.612899 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.612994 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.613204 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.613299 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.613507 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.613592 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.613809 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.613931 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.614116 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.614212 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.614419 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.614504 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.614720 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.614805 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.615055 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.615161 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.615323 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.615455 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.615627 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.615714 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.615927 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.616021 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.616230 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.616336 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.616558 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.616646 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.617453 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.617549 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.617844 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.617932 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.618155 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.618242 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.618463 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.618551 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.618770 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.618857 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.619106 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.619193 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.619418 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.619505 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.619727 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.619814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.620031 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.620118 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.620385 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.620475 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.620713 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.620811 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.621026 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.621123 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.621349 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.621442 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.621668 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.621804 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.621984 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.622094 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.622290 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.622377 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.622612 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.622700 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.622921 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.623020 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.623237 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.623324 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.623546 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.623631 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.623858 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.623956 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.624169 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.624256 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.624505 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.624594 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.624818 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.624905 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.625133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.625220 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.625444 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.625577 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.625754 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.625841 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.626077 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.626163 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.626399 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.626485 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.626705 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.626792 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.627015 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.627114 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.627342 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.627437 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.627655 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.627741 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.627970 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.628056 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.628281 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.628443 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.628620 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.628708 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.628933 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.629027 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.629245 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.629340 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.629555 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.629640 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.629868 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.629956 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.630180 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.630268 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.630495 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.630580 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.630806 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.630894 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.631121 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.631210 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.631436 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.631528 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.631753 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.631839 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.632082 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.632179 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.632454 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.632549 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.632771 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.632937 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.633117 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.633212 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.633444 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.633532 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.633759 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.633855 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.634075 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.634208 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.634382 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.634509 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.634625 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:55:18.634839 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.635157 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.635473 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.635780 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 17:55:18.636025 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 17:55:18.793185 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO dbcounter [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Registered counter for database nova_api Sep 01 17:55:18.803013 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO dbcounter [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Registered counter for database nova_api Sep 01 17:55:18.814179 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_db.sqlalchemy.engines [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:18.820841 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writer thread running {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:18.823278 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_db.sqlalchemy.engines [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:18.829728 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writer thread running {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:18.879627 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.context [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b184ec90-bfcf-4d57-9534-1fd348f70a38(cell1) {{(pid=106191) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:55:18.883887 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:55:18.884395 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:55:18.885957 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:55:18.886691 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:55:18.886957 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.context [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b184ec90-bfcf-4d57-9534-1fd348f70a38(cell1) {{(pid=106192) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 17:55:18.887137 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:55:18.889161 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:55:18.890785 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_concurrency.lockutils [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:55:18.891118 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO dbcounter [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Registered counter for database nova_cell0 Sep 01 17:55:18.891265 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_concurrency.lockutils [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:55:18.892857 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_concurrency.lockutils [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:55:18.893583 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_concurrency.lockutils [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 17:55:18.894012 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_concurrency.lockutils [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 17:55:18.895110 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO dbcounter [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Registered counter for database nova_cell1 Sep 01 17:55:18.895995 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_concurrency.lockutils [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106192) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 17:55:18.898494 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO dbcounter [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Registered counter for database nova_cell0 Sep 01 17:55:18.902361 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_db.sqlalchemy.engines [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:18.902620 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO dbcounter [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Registered counter for database nova_cell1 Sep 01 17:55:18.904901 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_db.sqlalchemy.engines [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:18.909817 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_db.sqlalchemy.engines [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:18.910099 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writer thread running {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:18.912113 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_db.sqlalchemy.engines [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:18.912882 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writer thread running {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:18.918605 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writer thread running {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:18.920040 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writer thread running {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:19.059355 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO dbcounter [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Registered counter for database nova_cell0 Sep 01 17:55:19.067938 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_db.sqlalchemy.engines [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:19.072737 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writer thread running {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:19.075058 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO dbcounter [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Registered counter for database nova_cell0 Sep 01 17:55:19.082512 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG oslo_db.sqlalchemy.engines [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 17:55:19.088737 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writer thread running {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 17:55:19.508676 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: WARNING keystonemiddleware.auth_token [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:55:19.515951 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: WARNING keystonemiddleware.auth_token [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:55:19.638431 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: WARNING keystonemiddleware.auth_token [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:55:19.645723 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: WARNING keystonemiddleware.auth_token [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:55:19.854695 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: WARNING keystonemiddleware.auth_token [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:55:19.860860 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: WARNING keystonemiddleware.auth_token [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:55:19.866272 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556af9a739c0 pid: 106191 (default app) Sep 01 17:55:19.868869 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:55:19.870142 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001961 Sep 01 17:55:19.870564 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Thu Sep 1 17:55:19 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:55:20.026336 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: WARNING keystonemiddleware.auth_token [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 17:55:20.032373 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: WARNING keystonemiddleware.auth_token [None req-3c317f60-f590-444a-a14c-0f1c5271a421 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 17:55:20.037730 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556af9a739c0 pid: 106192 (default app) Sep 01 17:56:41.507636 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:56:41.509400 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002270 Sep 01 17:56:41.515209 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:56:41.523861 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writing DB stats nova_api:SELECT=3 {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:41.525000 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writing DB stats nova_cell1:SELECT=3 {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:41.527640 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writing DB stats nova_cell0:SELECT=3 {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:41.529484 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:42.399022 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-ca8710e2-a01b-40df-984b-4d9ae70fe15a admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:56:42.433171 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-ca8710e2-a01b-40df-984b-4d9ae70fe15a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915745 Sep 01 17:56:42.433943 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 1 17:56:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:56:44.795491 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:56:44.796536 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-80b1f3a2-8e03-4827-ad6f-ab69e34ed53f None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 01 17:56:44.797083 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:56:45.269441 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-22d1a98c-b55b-44ef-8999-9312af88e613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "ram": 256}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:45.391989 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-22d1a98c-b55b-44ef-8999-9312af88e613 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.580520 Sep 01 17:56:45.391989 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:56:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:56:45.399808 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_api:SELECT=3 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:45.400923 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_cell0:SELECT=3 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:45.402105 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_cell1:SELECT=3 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:45.403093 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:56:45.616160 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-7244070a-4037-4134-85e2-3b61b255c555 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:45.780188 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-7244070a-4037-4134-85e2-3b61b255c555 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.386525 Sep 01 17:56:45.780720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 1 17:56:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:56:48.144622 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-22d1a98c-b55b-44ef-8999-9312af88e613 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:56:48.146368 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-22d1a98c-b55b-44ef-8999-9312af88e613 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Sep 01 17:56:48.146943 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:56:48.818414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-0e81d1fe-7b61-44b9-b61a-8986013c8f1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:48.921767 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-0e81d1fe-7b61-44b9-b61a-8986013c8f1a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.768228 Sep 01 17:56:48.922444 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:56:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:56:48.935089 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-ff44c9eb-bc91-4c81-ad12-cdad8a0e44ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:49.050556 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-ff44c9eb-bc91-4c81-ad12-cdad8a0e44ce admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119116 Sep 01 17:56:49.051458 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 1 17:56:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:56:51.412443 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-0e81d1fe-7b61-44b9-b61a-8986013c8f1a admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:56:51.413392 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-0e81d1fe-7b61-44b9-b61a-8986013c8f1a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 01 17:56:51.413820 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:56:51.812031 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-97398b9f-b811-4744-9b90-e566274db711 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:51.873864 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-97398b9f-b811-4744-9b90-e566274db711 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453875 Sep 01 17:56:51.874527 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:56:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:56:51.887297 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-6fed6332-361d-43b8-891b-0a500d497346 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:51.957785 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-6fed6332-361d-43b8-891b-0a500d497346 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073964 Sep 01 17:56:51.968348 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 1 17:56:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:56:54.387302 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-97398b9f-b811-4744-9b90-e566274db711 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:56:54.388348 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-97398b9f-b811-4744-9b90-e566274db711 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 01 17:56:54.388762 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:56:54.838622 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-a3652e40-ef6c-4c93-abca-03b252d84b47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:54.927236 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-a3652e40-ef6c-4c93-abca-03b252d84b47 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531320 Sep 01 17:56:54.928048 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:56:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:56:54.940426 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-d6177e47-969d-47ae-859f-0fab2dc8b131 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:55.044533 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-d6177e47-969d-47ae-859f-0fab2dc8b131 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107948 Sep 01 17:56:55.045193 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 1 17:56:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:56:57.445632 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-a3652e40-ef6c-4c93-abca-03b252d84b47 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:56:57.447205 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-a3652e40-ef6c-4c93-abca-03b252d84b47 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Sep 01 17:56:57.448590 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:56:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:56:57.877558 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-466cd0ec-b8d7-4593-b9a8-7aa4c9aea3c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:57.965102 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-466cd0ec-b8d7-4593-b9a8-7aa4c9aea3c8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510898 Sep 01 17:56:57.966175 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:56:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:56:57.984347 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-293f02d8-8c51-485d-9c1f-d08548e0693f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:56:58.181087 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-293f02d8-8c51-485d-9c1f-d08548e0693f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.204212 Sep 01 17:56:58.182229 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Thu Sep 1 17:56:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:57:00.515049 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-466cd0ec-b8d7-4593-b9a8-7aa4c9aea3c8 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:00.516420 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-466cd0ec-b8d7-4593-b9a8-7aa4c9aea3c8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001941 Sep 01 17:57:00.517128 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:00.967064 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-02071150-1c89-4d9e-a9f6-02b7f1f31765 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:01.003045 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-02071150-1c89-4d9e-a9f6-02b7f1f31765 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476895 Sep 01 17:57:01.004588 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 1 17:57:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:57:03.440437 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-466cd0ec-b8d7-4593-b9a8-7aa4c9aea3c8 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:03.442100 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-466cd0ec-b8d7-4593-b9a8-7aa4c9aea3c8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Sep 01 17:57:03.442643 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:03.885115 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-a61c8a0f-f516-4722-9556-d6e978a7a510 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:03.960247 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-a61c8a0f-f516-4722-9556-d6e978a7a510 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.509836 Sep 01 17:57:03.960856 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:57:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:57:03.974425 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-aee0cb3f-754f-40fc-bf6d-4c947c83ef55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:04.044912 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-aee0cb3f-754f-40fc-bf6d-4c947c83ef55 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075406 Sep 01 17:57:04.051687 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 1 17:57:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:57:06.405986 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-a61c8a0f-f516-4722-9556-d6e978a7a510 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:06.406997 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-a61c8a0f-f516-4722-9556-d6e978a7a510 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 01 17:57:06.407403 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:06.808971 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-e3192bf1-0cac-4c17-b369-2fd3262b626b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:06.879982 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-e3192bf1-0cac-4c17-b369-2fd3262b626b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466280 Sep 01 17:57:06.880644 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:57:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:57:06.894623 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-360502df-9115-4411-b8f2-aabb4c0dd1b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:06.980480 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-360502df-9115-4411-b8f2-aabb4c0dd1b2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091232 Sep 01 17:57:06.981118 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 1 17:57:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:57:09.613879 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-e3192bf1-0cac-4c17-b369-2fd3262b626b admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:09.614822 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-e3192bf1-0cac-4c17-b369-2fd3262b626b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Sep 01 17:57:09.620678 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:57:09.997568 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-05d1ef43-9e82-4133-bdf0-09dab8b3098a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "id": "3", "vcpus": 2}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:10.092208 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-05d1ef43-9e82-4133-bdf0-09dab8b3098a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.470045 Sep 01 17:57:10.092906 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:57:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:57:10.107330 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-307a6d19-2a21-43cb-b6bc-31dfd217e2f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:10.182005 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-307a6d19-2a21-43cb-b6bc-31dfd217e2f0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079774 Sep 01 17:57:10.182916 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 1 17:57:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:57:12.597230 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-05d1ef43-9e82-4133-bdf0-09dab8b3098a admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:12.598583 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-05d1ef43-9e82-4133-bdf0-09dab8b3098a admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 Sep 01 17:57:12.599184 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:57:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:13.069130 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-475e89f3-f65a-42ff-9aaf-5945c79ad703 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:13.075692 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:13.146202 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-475e89f3-f65a-42ff-9aaf-5945c79ad703 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.540756 Sep 01 17:57:13.147356 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:57:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:57:13.160917 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-a1d4b2aa-ffa1-4544-af21-84a711ed7611 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:13.249561 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-a1d4b2aa-ffa1-4544-af21-84a711ed7611 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093535 Sep 01 17:57:13.250915 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 1 17:57:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:57:15.699749 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-475e89f3-f65a-42ff-9aaf-5945c79ad703 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:15.701519 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-475e89f3-f65a-42ff-9aaf-5945c79ad703 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Sep 01 17:57:15.702131 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:16.138636 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-5366b5cb-c621-4ae0-a385-e772f056b9c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:16.145159 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:57:16.251641 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-5366b5cb-c621-4ae0-a385-e772f056b9c4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.542559 Sep 01 17:57:16.256391 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Thu Sep 1 17:57:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:57:16.265523 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-c2649fd6-b705-438a-b5ca-fd9d9304a024 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:16.370218 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-c2649fd6-b705-438a-b5ca-fd9d9304a024 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108406 Sep 01 17:57:16.370921 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Thu Sep 1 17:57:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 17:57:35.565830 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-5366b5cb-c621-4ae0-a385-e772f056b9c4 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:35.566765 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-5366b5cb-c621-4ae0-a385-e772f056b9c4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Sep 01 17:57:35.567165 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:35.954801 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-47a329d0-422a-4bb0-a632-3e901bb33bff admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:35.974833 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-47a329d0-422a-4bb0-a632-3e901bb33bff admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401509 Sep 01 17:57:35.975367 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 1 17:57:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:57:37.031179 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-5366b5cb-c621-4ae0-a385-e772f056b9c4 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:37.032182 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-5366b5cb-c621-4ae0-a385-e772f056b9c4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 01 17:57:37.032606 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:37.681786 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fab00929-d114-492f-8fcd-a5397c782279 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:37.687403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.wsgi [None req-fab00929-d114-492f-8fcd-a5397c782279 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fab00929-d114-492f-8fcd-a5397c782279 admin admin] Request method failure captured: Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Accept: application/json Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Accept-Encoding: gzip, deflate Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Connection: keep-alive Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Content-Length: 0 Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Host: 10.222.0.15 Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Openstack-Api-Version: compute 2.90 Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Openstack-System-Scope: None Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: User-Agent: python-novaclient Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Auth-Token: gAAAAABjEPKQNfSX_YqlxfQZdjNNgwGOltavGq6CgigVS_yBNiniFzmYK_K5RODMgBGFuXzlFPiDVqI3cAQBA-nTpJufcDrekyVd3oOFgZtENjGqZZpX4RBjB9jrP3V0QEUpMb7r3eXY_HblrRelqr2Vr7zOmhB6aV2jJhxe4FZa0m8KeS0lLZo Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Domain-Id: None Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Domain-Name: None Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Identity-Status: Confirmed Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Is-Admin-Project: True Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Domain-Id: default Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Domain-Name: Default Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Name: admin Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Role: member,admin,reader Sep 01 17:57:37.690851 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Roles: member,admin,reader Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_195190be58ff49f7a586c1baca5891d6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant: admin Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant-Name: admin Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User: admin Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Domain-Id: default Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Domain-Name: Default Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Id: 1369adf90e6146c298833c5db7ff437b Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Name: admin Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: method: > Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: exception: Flavor 42 could not be found. Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: action_args: {'id': '42'} Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:57:37.692674 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:37.693814 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.695225 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fab00929-d114-492f-8fcd-a5397c782279 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:57:37.696587 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fab00929-d114-492f-8fcd-a5397c782279 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.521544 Sep 01 17:57:37.696587 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 1 17:57:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:37.702276 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-9b17c88f-84f9-450d-88a7-bf470cf4ed7b admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:37.726517 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-9b17c88f-84f9-450d-88a7-bf470cf4ed7b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028047 Sep 01 17:57:37.727067 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 1 17:57:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:57:37.736796 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-4046c357-4a73-47e6-acf1-4b6f8cb11b57 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:37.759363 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-4046c357-4a73-47e6-acf1-4b6f8cb11b57 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026133 Sep 01 17:57:37.759893 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 1 17:57:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 17:57:37.769998 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-e42e0c47-ff7b-48bc-848c-0c377fc9d647 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:37.775864 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.wsgi [None req-e42e0c47-ff7b-48bc-848c-0c377fc9d647 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-e42e0c47-ff7b-48bc-848c-0c377fc9d647 admin admin] Request method failure captured: Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Accept: application/json Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Accept-Encoding: gzip, deflate Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Connection: keep-alive Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Content-Length: 0 Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Host: 10.222.0.15 Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Openstack-Api-Version: compute 2.90 Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Openstack-System-Scope: None Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: User-Agent: python-novaclient Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Auth-Token: gAAAAABjEPKQNfSX_YqlxfQZdjNNgwGOltavGq6CgigVS_yBNiniFzmYK_K5RODMgBGFuXzlFPiDVqI3cAQBA-nTpJufcDrekyVd3oOFgZtENjGqZZpX4RBjB9jrP3V0QEUpMb7r3eXY_HblrRelqr2Vr7zOmhB6aV2jJhxe4FZa0m8KeS0lLZo Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Domain-Id: None Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Domain-Name: None Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Identity-Status: Confirmed Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Is-Admin-Project: True Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Domain-Id: default Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Domain-Name: Default Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Name: admin Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Role: member,admin,reader Sep 01 17:57:37.779130 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Roles: member,admin,reader Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_195190be58ff49f7a586c1baca5891d6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant: admin Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant-Name: admin Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User: admin Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Domain-Id: default Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Domain-Name: Default Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Id: 1369adf90e6146c298833c5db7ff437b Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Name: admin Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: method: > Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: exception: Flavor 42 could not be found. Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: action_args: {'id': '42'} Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:57:37.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:37.787720 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:37.789062 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-e42e0c47-ff7b-48bc-848c-0c377fc9d647 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:57:37.790393 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-e42e0c47-ff7b-48bc-848c-0c377fc9d647 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014998 Sep 01 17:57:37.790393 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 1 17:57:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:38.754718 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-4046c357-4a73-47e6-acf1-4b6f8cb11b57 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:38.755732 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-4046c357-4a73-47e6-acf1-4b6f8cb11b57 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 01 17:57:38.756126 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:39.282958 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-efd0c988-f166-47d9-8538-ea18bea5d9fe admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:39.288942 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.wsgi [None req-efd0c988-f166-47d9-8538-ea18bea5d9fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-efd0c988-f166-47d9-8538-ea18bea5d9fe admin admin] Request method failure captured: Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Accept: application/json Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Accept-Encoding: gzip, deflate Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Connection: keep-alive Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Content-Length: 0 Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Host: 10.222.0.15 Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Openstack-Api-Version: compute 2.90 Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Openstack-System-Scope: None Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: User-Agent: python-novaclient Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Auth-Token: gAAAAABjEPKS7ucT4OkQ06WUlDm3TL6SIJAw877C9QfDnh-m8MRGjg7tLgYGydjZpbLBX0mVWvYn415yiK86dZjN88NYNdp4cEzwbNpkSS3Sjmz1LP0FZCZ_QE2SNs0--SUBuaHqT_53lUCXFX2mCBs9IrlMjWDO3kO5o_NCMQQsA8Y67UAdbWg Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Domain-Id: None Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Domain-Name: None Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Identity-Status: Confirmed Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Is-Admin-Project: True Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Domain-Id: default Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Domain-Name: Default Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Name: admin Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Role: member,admin,reader Sep 01 17:57:39.290563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Roles: member,admin,reader Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_195190be58ff49f7a586c1baca5891d6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant: admin Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant-Name: admin Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User: admin Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Domain-Id: default Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Domain-Name: Default Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Id: 1369adf90e6146c298833c5db7ff437b Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Name: admin Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: method: > Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: exception: Flavor 84 could not be found. Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: action_args: {'id': '84'} Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:57:39.292133 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:39.293129 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.294565 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-efd0c988-f166-47d9-8538-ea18bea5d9fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:57:39.295609 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-efd0c988-f166-47d9-8538-ea18bea5d9fe admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399242 Sep 01 17:57:39.295609 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 1 17:57:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:39.302577 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fa4106a3-a5cb-4f98-8897-7de06ef42ab1 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:39.318068 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fa4106a3-a5cb-4f98-8897-7de06ef42ab1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019952 Sep 01 17:57:39.318589 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 1 17:57:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:57:39.327769 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-895c84a9-5084-4dc8-9284-c13e17476380 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:39.343008 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-895c84a9-5084-4dc8-9284-c13e17476380 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018691 Sep 01 17:57:39.343546 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 1 17:57:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:57:39.353297 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-02a58f3e-d659-42d0-85c9-76e44f2cb138 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:39.358608 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.wsgi [None req-02a58f3e-d659-42d0-85c9-76e44f2cb138 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-02a58f3e-d659-42d0-85c9-76e44f2cb138 admin admin] Request method failure captured: Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Accept: application/json Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Accept-Encoding: gzip, deflate Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Connection: keep-alive Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Content-Length: 0 Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Host: 10.222.0.15 Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Openstack-Api-Version: compute 2.90 Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Openstack-System-Scope: None Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: User-Agent: python-novaclient Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Auth-Token: gAAAAABjEPKS7ucT4OkQ06WUlDm3TL6SIJAw877C9QfDnh-m8MRGjg7tLgYGydjZpbLBX0mVWvYn415yiK86dZjN88NYNdp4cEzwbNpkSS3Sjmz1LP0FZCZ_QE2SNs0--SUBuaHqT_53lUCXFX2mCBs9IrlMjWDO3kO5o_NCMQQsA8Y67UAdbWg Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Domain-Id: None Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Domain-Name: None Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Identity-Status: Confirmed Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Is-Admin-Project: True Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Domain-Id: default Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Domain-Name: Default Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Name: admin Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Role: member,admin,reader Sep 01 17:57:39.360087 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Roles: member,admin,reader Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_195190be58ff49f7a586c1baca5891d6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant: admin Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant-Name: admin Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User: admin Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Domain-Id: default Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Domain-Name: Default Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Id: 1369adf90e6146c298833c5db7ff437b Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Name: admin Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: method: > Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: exception: Flavor 84 could not be found. Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: action_args: {'id': '84'} Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:57:39.365403 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:39.366388 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:39.367777 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-02a58f3e-d659-42d0-85c9-76e44f2cb138 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:57:39.369088 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-02a58f3e-d659-42d0-85c9-76e44f2cb138 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011785 Sep 01 17:57:39.369088 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Thu Sep 1 17:57:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:40.337777 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-895c84a9-5084-4dc8-9284-c13e17476380 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:40.338790 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-895c84a9-5084-4dc8-9284-c13e17476380 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 01 17:57:40.339179 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:40.869162 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-a3c3c32c-f260-4019-8738-4af696ada24a admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:40.874820 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.wsgi [None req-a3c3c32c-f260-4019-8738-4af696ada24a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-a3c3c32c-f260-4019-8738-4af696ada24a admin admin] Request method failure captured: Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Accept: application/json Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Accept-Encoding: gzip, deflate Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Connection: keep-alive Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Content-Length: 0 Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Host: 10.222.0.15 Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Openstack-Api-Version: compute 2.90 Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Openstack-System-Scope: None Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: User-Agent: python-novaclient Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Auth-Token: gAAAAABjEPKUdE8JN67pl2u31bnogyu2aKPH57Sg05jnGkQSKLsTmk4w1twyosbRBzUowTo9PuLAg8osKAR8B5CaLDxcGwdx2keSgyqJIQ4WkqUBLXyEUYMHPLLtObFr6VJJUCBOcauydJl--M9QhJf_Wvy3zRQBgyoAlF3ZiU2EGC5haafXkE4 Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Domain-Id: None Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Domain-Name: None Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Identity-Status: Confirmed Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Is-Admin-Project: True Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Domain-Id: default Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Domain-Name: Default Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Project-Name: admin Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Role: member,admin,reader Sep 01 17:57:40.876303 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Roles: member,admin,reader Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_195190be58ff49f7a586c1baca5891d6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant: admin Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-Tenant-Name: admin Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User: admin Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Domain-Id: default Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Domain-Name: Default Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Id: 1369adf90e6146c298833c5db7ff437b Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: X-User-Name: admin Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: method: > Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: exception: Flavor 451 could not be found. Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: action_args: {'id': '451'} Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:57:40.878295 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:40.879307 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.880773 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-a3c3c32c-f260-4019-8738-4af696ada24a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106192) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:57:40.882143 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-a3c3c32c-f260-4019-8738-4af696ada24a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.399668 Sep 01 17:57:40.882143 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 1 17:57:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:40.889305 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-fd8b71bc-450f-41b3-be17-798a5e3f6821 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:40.905707 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-fd8b71bc-450f-41b3-be17-798a5e3f6821 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019957 Sep 01 17:57:40.906287 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 1 17:57:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:57:40.916811 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:40.931896 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018698 Sep 01 17:57:40.932424 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Thu Sep 1 17:57:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:57:40.941992 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-0e072690-046f-4d63-afd1-428b65a96a50 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:40.947325 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.wsgi [None req-0e072690-046f-4d63-afd1-428b65a96a50 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-0e072690-046f-4d63-afd1-428b65a96a50 admin admin] Request method failure captured: Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Accept: application/json Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Accept-Encoding: gzip, deflate Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Connection: keep-alive Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Content-Length: 0 Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Host: 10.222.0.15 Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Openstack-Api-Version: compute 2.90 Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Openstack-System-Scope: None Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: User-Agent: python-novaclient Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Auth-Token: gAAAAABjEPKUdE8JN67pl2u31bnogyu2aKPH57Sg05jnGkQSKLsTmk4w1twyosbRBzUowTo9PuLAg8osKAR8B5CaLDxcGwdx2keSgyqJIQ4WkqUBLXyEUYMHPLLtObFr6VJJUCBOcauydJl--M9QhJf_Wvy3zRQBgyoAlF3ZiU2EGC5haafXkE4 Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Domain-Id: None Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Domain-Name: None Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Identity-Status: Confirmed Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Is-Admin-Project: True Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Domain-Id: default Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Domain-Name: Default Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Project-Name: admin Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Role: member,admin,reader Sep 01 17:57:40.948840 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Roles: member,admin,reader Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_195190be58ff49f7a586c1baca5891d6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/195190be58ff49f7a586c1baca5891d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant: admin Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant-Id: 195190be58ff49f7a586c1baca5891d6 Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-Tenant-Name: admin Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User: admin Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Domain-Id: default Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Domain-Name: Default Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Id: 1369adf90e6146c298833c5db7ff437b Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: X-User-Name: admin Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: method: > Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: exception: Flavor 451 could not be found. Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: action_args: {'id': '451'} Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 17:57:40.950390 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:40.951414 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: ERROR nova.api.openstack.wsgi Sep 01 17:57:40.952850 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-0e072690-046f-4d63-afd1-428b65a96a50 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 17:57:40.954174 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-0e072690-046f-4d63-afd1-428b65a96a50 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012070 Sep 01 17:57:40.954174 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 1 17:57:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 17:57:41.929962 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:41.930974 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 01 17:57:41.931370 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:42.453602 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-707092ef-d55d-4c02-b106-063c54db1120 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:42.559355 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-707092ef-d55d-4c02-b106-063c54db1120 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.490958 Sep 01 17:57:42.559853 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 1 17:57:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:57:43.539469 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:43.540532 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 01 17:57:43.540937 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:44.070629 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-8d7700f0-faa4-4845-961d-d45bb2c8f377 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:44.131387 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-8d7700f0-faa4-4845-961d-d45bb2c8f377 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.445898 Sep 01 17:57:44.140456 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 1 17:57:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:57:45.104274 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:45.105366 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 01 17:57:45.105767 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 17:57:45.638221 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-642c0d99-dd10-41ef-8733-817f017efe01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:45.725376 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-642c0d99-dd10-41ef-8733-817f017efe01 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.483162 Sep 01 17:57:45.725909 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 1 17:57:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 17:57:46.700057 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:46.701127 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 01 17:57:46.701523 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:47.226145 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-06f2d5d9-9101-4786-9866-a81f2c57300d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 17:57:47.280619 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-06f2d5d9-9101-4786-9866-a81f2c57300d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.441971 Sep 01 17:57:47.281375 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Thu Sep 1 17:57:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 17:57:48.264799 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:48.265846 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 01 17:57:48.266241 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 17:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:57:48.805102 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-362e5b59-b449-4d32-82c6-eeec885a92a5 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:57:48.825343 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-362e5b59-b449-4d32-82c6-eeec885a92a5 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.422122 Sep 01 17:57:48.825873 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Thu Sep 1 17:57:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:58:42.676002 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:58:42.676986 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-fea98e9b-5932-4432-8fcc-54a1c1d6bf2e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 01 17:58:42.677389 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Thu Sep 1 17:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 17:58:42.689110 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:43.075751 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-16320179-854b-4742-9434-cccaa22015c0 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:58:43.096856 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-16320179-854b-4742-9434-cccaa22015c0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412744 Sep 01 17:58:43.100273 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Thu Sep 1 17:58:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 17:58:43.118254 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG dbcounter [-] [106192] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 17:58:43.122021 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-384828a6-e3e9-4e58-b0af-e0c1ea879cf8 admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:58:43.130242 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-384828a6-e3e9-4e58-b0af-e0c1ea879cf8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013369 Sep 01 17:58:43.130824 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Sep 1 17:58:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:58:43.143187 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-9a2368bd-4868-4a7b-8ac7-11786cf1a028 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:58:43.151251 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-9a2368bd-4868-4a7b-8ac7-11786cf1a028 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012429 Sep 01 17:58:43.151784 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Sep 1 17:58:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:58:43.163614 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:58:43.171110 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011045 Sep 01 17:58:43.171615 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Thu Sep 1 17:58:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 17:58:43.183046 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-39bb7a44-1f57-43d8-9228-631ad943f974 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 17:58:43.191563 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-39bb7a44-1f57-43d8-9228-631ad943f974 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011981 Sep 01 17:58:43.192086 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Thu Sep 1 17:58:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:01:52.243135 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:01:52.244157 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 01 18:01:52.244601 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 18:01:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:01:52.387308 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_api:SELECT=6 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:01:52.563030 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:01:52.566698 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:01:52.567260 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:01:52.567684 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:01:52.568410 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:01:52.568886 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:01:52.569293 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:01:52.607110 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-0bb1faed-de18-4183-8922-1f009da797d2 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.221133 Sep 01 18:01:52.607667 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 1 18:01:52 2022] GET /compute/v2.1/os-services => generated 794 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 18:01:53.456549 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:01:53.458360 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Sep 01 18:01:53.458958 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 18:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:01:53.648690 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:01:53.652083 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:01:53.652591 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:01:53.653021 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:01:53.653989 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:01:53.654434 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:01:53.654851 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:01:53.675338 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-f1d55536-c74d-4ef7-8e68-208d0289b28d admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080200 Sep 01 18:01:53.676424 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 1 18:01:53 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:02:04.920586 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:02:04.921597 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 01 18:02:04.921985 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 18:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:02:05.067158 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_cell0:SELECT=4 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:02:05.068121 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_cell1:SELECT=4 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:02:05.068787 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG dbcounter [-] [106191] Writing DB stats nova_api:SELECT=8 {{(pid=106191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:02:05.122807 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:02:05.126226 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:02:05.129780 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:02:05.129780 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:02:05.129780 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:02:05.129780 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:02:05.130146 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:02:05.154381 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-77614ec1-d9f4-410d-9bf4-5299b20f0d04 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.092507 Sep 01 18:02:05.154928 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 1 18:02:05 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:02:05.982114 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: DEBUG nova.api.openstack.wsgi [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] Calling method '>' {{(pid=106192) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:02:05.983135 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: INFO nova.api.openstack.requestlog [None req-81cf3387-6cdc-4112-8459-1006734a01cb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 01 18:02:05.983534 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: [pid: 106192|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Thu Sep 1 18:02:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:02:06.175210 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG nova.api.openstack.wsgi [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] Calling method '>' {{(pid=106191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:02:06.179395 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:02:06.179862 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:02:06.180286 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:02:06.181011 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:02:06.181472 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:02:06.181886 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: DEBUG oslo_concurrency.lockutils [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:02:06.204043 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: INFO nova.api.openstack.requestlog [None req-39f1b50c-183f-4bff-b6fe-1c5b66be950c admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080908 Sep 01 18:02:06.204540 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: [pid: 106191|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Thu Sep 1 18:02:06 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:03:04.357300 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: Thu Sep 1 18:03:04 2022 - graceful shutdown triggered... Sep 01 18:03:04.357411 dv-cinder-749155-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 18:03:04.358341 dv-cinder-749155-10-iscsi devstack@n-api.service[106191]: Gracefully killing worker 1 (pid: 106191)... Sep 01 18:03:04.358725 dv-cinder-749155-10-iscsi devstack@n-api.service[106192]: Gracefully killing worker 2 (pid: 106192)... Sep 01 18:03:05.359053 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: worker 1 buried after 1 seconds Sep 01 18:03:05.359512 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: worker 2 buried after 1 seconds Sep 01 18:03:05.359512 dv-cinder-749155-10-iscsi devstack@n-api.service[106190]: goodbye to uWSGI. Sep 01 18:03:05.360619 dv-cinder-749155-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 18:03:05.361170 dv-cinder-749155-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 18:03:05.363985 dv-cinder-749155-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 18:03:05.375361 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 18:03:05 2022] *** Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: nodename: dv-cinder-749155-10-iscsi Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: machine: x86_64 Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: clock source: unix Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: pcre jit disabled Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: detected number of CPU cores: 4 Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: current working directory: / Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: detected binary path: /usr/bin/uwsgi-core Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: your processes number limit is 47680 Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: your memory page size is 4096 bytes Sep 01 18:03:05.377306 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: detected max file descriptor number: 2048 Sep 01 18:03:05.378312 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: lock engine: pthread robust mutexes Sep 01 18:03:05.378312 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: thunder lock: enabled Sep 01 18:03:05.378312 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 18:03:05.378312 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 18:03:05.418598 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: Python main interpreter initialized at 0x556b810989c0 Sep 01 18:03:05.418598 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: python threads support enabled Sep 01 18:03:05.418598 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: your server socket listen backlog is limited to 100 connections Sep 01 18:03:05.418598 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: your mercy for graceful operations on workers is 90 seconds Sep 01 18:03:05.419045 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 18:03:05.419045 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: *** Operational MODE: preforking *** Sep 01 18:03:05.419332 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: *** uWSGI is running in multiple interpreter mode *** Sep 01 18:03:05.419332 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: spawned uWSGI master process (pid: 121202) Sep 01 18:03:05.419541 dv-cinder-749155-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 18:03:05.422962 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: spawned uWSGI worker 1 (pid: 121220, cores: 1) Sep 01 18:03:05.422962 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: spawned uWSGI worker 2 (pid: 121221, cores: 1) Sep 01 18:03:05.422962 dv-cinder-749155-10-iscsi devstack@n-api.service[121202]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 18:03:06.099266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 18:03:06.102508 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 18:03:07.267240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 18:03:07.267240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: from cryptography.utils import int_from_bytes Sep 01 18:03:07.267870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 18:03:07.267870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: from cryptography.utils import int_from_bytes Sep 01 18:03:07.268926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 18:03:07.268926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: from cryptography.utils import int_from_bytes Sep 01 18:03:07.269360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 18:03:07.269360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: from cryptography.utils import int_from_bytes Sep 01 18:03:09.669207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 18:03:09.669820 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 18:03:09.670008 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 18:03:09.670377 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 18:03:09.670631 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 18:03:09.671025 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.671349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.671666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.671983 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.672334 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.672648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.672967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.673284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.673610 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.673866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.674221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.674498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-10-iscsi {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.674991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.675303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.675616 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.675938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.676243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.676594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.676900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.677437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.678210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.678760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.678946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.679299 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.679615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.679926 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.680252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.680592 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.680920 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.681227 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.681646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-10-iscsi {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.682078 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.682408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.682712 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.683140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.684028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.684028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.684028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.684410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.684707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.685047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.685366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.685681 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.685999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.686303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.686617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.686929 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.687246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.687551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.687853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.688101 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.688432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.688753 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.689070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.689398 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.689649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.689906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.690402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.690537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.690861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.691155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.691456 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.691759 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.692063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.692396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.692784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.693526 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.694070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.694507 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.694832 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.695140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.695460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.695870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.696122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.696454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.696798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.697121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.697437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.697744 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.698063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.698372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.698681 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.698989 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.699312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.699650 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.699959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.700210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.700537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.700868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.701168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.701477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.701777 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.702081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.702381 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.702687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.702990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.703345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.703597 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.703903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.704351 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.704538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.704844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.705148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.705451 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.705771 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.706088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.706393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.706697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.707000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.707305 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.707620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.707925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.708228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.708574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.709463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.709769 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.710088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.710395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.710700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.711017 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.711323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.711628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.711940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.712246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.712573 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.712874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.713175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.713477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.713779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.714080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.714380 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.714679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.714991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.715308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.715619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.715924 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.716228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.716565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.716900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.717226 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.717566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.717874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.718203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.718530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.718704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 18:03:09.719124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.719228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 18:03:09.719323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.719443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.719536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 18:03:09.719766 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.719869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 18:03:09.720075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.720176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 18:03:09.720405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.720515 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.720716 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.720820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.721031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.721129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.721348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.721468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.721677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.721792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.721991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.722096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.722310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.722415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.722624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.722730 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.722935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.723036 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.723220 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.723311 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.723543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.723639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.723879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-749155-10-iscsi {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.723985 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.724183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.724427 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.724611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.724751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.724931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.725244 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.725336 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.725568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.725671 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.725880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.725982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.726188 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.726294 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.726500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.726602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.726810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.727011 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.727151 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.727331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.727475 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.727647 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.727857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.727971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.728127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.728296 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.728463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.728637 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.728786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.728954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.729104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.729423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.729597 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.729755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.729914 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.730075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.730228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.730331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.730548 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.730654 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.730961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-749155-10-iscsi {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.731059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.731284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.731396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.731599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.731706 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.731914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.732142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.732232 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.732408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.732587 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.732728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.733014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.733194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.733327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.733527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.733622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.733862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.733998 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.734221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.734466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.734581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.734816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.734973 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.735125 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.735277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.735450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.735590 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.735758 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.735902 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.736058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.736205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.736380 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.736475 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.736698 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.736789 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.737017 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.737106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.737352 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.737583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.737698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.737785 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.737869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.737956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.738189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.738304 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.738493 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.738587 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.738817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.738919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.739124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.739218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.739380 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.739484 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.739635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.739730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.740060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.740173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.740430 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.740569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.740887 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.740979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.741200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.741293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.741511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.741606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.741823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.741913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.742132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.742223 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.742443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.742536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.742758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.742885 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.743066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.743172 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.743389 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.743491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.743705 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.747859 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.747859 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.761449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.761605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.762456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.762566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.762643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.762725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.762815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.762895 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.762974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.763054 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.763135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.763244 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.763387 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.763512 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.763599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.763673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.763742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.763819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.763890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.763977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.764050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.764120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.764189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.764258 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.764353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.764445 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.764519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.764590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.764668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.764745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.764824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.764908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.764987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.765118 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.765240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.765361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.765449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.765531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.765603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.765673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.766861 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.767053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.767237 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.767401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.767553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.767553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.767845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.768001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.768413 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.768675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.768842 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.768998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.769146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.769301 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.769463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.769631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.769787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.769934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.770088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.770235 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.770395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.770551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.770699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.770856 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.771005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.771196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.771858 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.772014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.772178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.772365 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.772521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.772685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.772835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.772989 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.773136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.773282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.773428 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.773583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.773730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.773877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.774038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.774202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.774349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.774501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.774648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.774819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.774989 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.775138 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.775284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.775431 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.775583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.775730 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.775885 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.776032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.776196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.776374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.776538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.777096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.777262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.777410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.777564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.777712 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.777872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.778031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.778186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.778459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.778664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.778933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.779087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.779246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.779246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.779535 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.779687 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.780113 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.780294 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.780477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.780625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.780625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.780907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.781074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.781074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.781369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.781514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.781514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.781798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.781944 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.781944 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.782251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.782408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.782554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.782707 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 18:03:09.782853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.783023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.783177 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.783325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.783477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.783632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.783786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.783949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.784096 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.784248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.784433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.784588 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.784745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.784899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785836 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.785964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786199 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.786774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.787371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.787371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.787603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.787784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.787784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.788014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.788140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.788140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.789129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790433 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790570 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790570 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.790999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.791269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.791269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.791525 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.791666 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.791809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.791949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.792090 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.792237 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.792402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.792549 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.792696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.792839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.792979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.793119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.793119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.793366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.793506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.793506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.793770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.793902 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.794039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.794170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.794310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.794451 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.794582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.794720 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.794864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795671 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795671 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.795942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.796197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.796368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.796501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.796501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.796781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.796781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.797053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.797432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.797574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.797707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.797852 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.797852 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.798133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.798374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.798518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.798649 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.798867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.799028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.799028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.799462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.799782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.799946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.800082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.800222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.800383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.800516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.800647 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.800794 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.800929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.801075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.801217 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.801363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.801516 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.801661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.801794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.801926 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.802071 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.802071 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.802354 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.803082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.803289 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.803446 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.803626 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.803807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.803951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.804092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.804226 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.804447 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.804592 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.804733 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.804865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805272 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805414 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.805815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806221 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806894 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.806894 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.807151 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.807510 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.807510 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.808761 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.808924 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.809061 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.809177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.809177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.809622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.809846 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.809993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.810176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.810176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.810464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.810597 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.810779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.810921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.810921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.811185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.811356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.811356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.811626 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.811759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.811898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.812039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.812039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.812295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.812489 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.812625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.812765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.812765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813017 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813542 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813681 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.813958 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.814099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.814099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.814345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.814491 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.814631 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.814778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.814778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815035 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815167 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815167 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815575 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.815838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.816098 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.816229 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.816391 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.816551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.816687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.817201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.817201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.817692 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.817838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.817838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.818172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.818906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.819197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.819349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.819349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.819778 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820006 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820733 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820733 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.820992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.821125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.821266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.821442 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.821584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.821700 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.821838 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.821998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.822118 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.822239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.822239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.822452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.822565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.822565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.822811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.824556 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.824725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.824873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.824873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825829 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.825969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.826227 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.826359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.826498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.826639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.826639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.826897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.827036 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.827036 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.827301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.827447 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.827790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.827939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.827939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.828196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.828374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.828374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.828689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.828822 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.828953 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.829100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.829100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.829471 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.829798 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.829947 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.830176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.830346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.830495 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.830495 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.830745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.830877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831009 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831398 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831540 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.831960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832855 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.832998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.833255 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.833393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.833533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.833707 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.833860 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.834006 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.834168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.834425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.834651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.834651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.834929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835061 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.835984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.836242 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.836443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.836580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.836713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.836713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.836968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.837113 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.837113 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.837378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.837511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.837511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.837982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.838137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.838271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.838411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.838550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.838689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.838689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.839027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.839170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.839170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.839522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.839664 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.839819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.840159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.840159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.840545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.840764 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.840914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.841961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.842208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.842348 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.842479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.842620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.842620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.842915 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843336 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843336 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843712 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843852 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.843984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.844244 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.844432 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.844432 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.844705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.844845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.844845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.845160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.845294 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.845441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.845587 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.845587 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.845837 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.845976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.846114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.846255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.846255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.846522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.846654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.846654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.846910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.847050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.847184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.847323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.847323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.847587 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.847719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.847859 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.848401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.848544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.848686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.848686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.848943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.849084 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.849259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.849401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.849401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.849667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.849894 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.849894 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.850360 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.850573 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.851283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.851424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.851424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.851691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.851832 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.851965 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.852096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.852096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.852379 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.852524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.852524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.852780 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.852920 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.853060 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.853201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.853201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.853458 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.853591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.853591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.853848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.854945 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.855084 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.855224 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.855367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.855367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.855633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.855765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.855897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856294 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.856998 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857538 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857538 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857946 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.857946 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.858406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.858541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.858683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.858819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.858819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859494 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859610 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859724 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.859724 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.860056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.860269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.860269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.869489 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.869651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.869815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.869973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.869973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.870491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.870813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.870813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.871114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.871262 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.871262 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.871553 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.871700 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.871856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.872019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.872019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.872396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.872562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.872820 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.872988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.873146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.873294 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.873457 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.873606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.873606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.873901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.874062 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.874228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.874383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.874532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.874696 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.874902 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.874902 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.875265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.875265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.875725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.875725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.876018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.876203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.876408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.876573 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.876722 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.876876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.877042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.877042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.877337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.877485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.877782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.877782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.878091 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.878251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.878418 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.878805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.878969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.878969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.879266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.879436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.879584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.879739 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.879886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.880032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.880185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.880526 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.881481 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.881636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.881793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.881942 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.882099 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.882270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.882417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.882563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.882709 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.882947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.883115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.883273 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.883421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.883575 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.883730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.883885 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.883885 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.884187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.884367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.884531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.884686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.884833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.884999 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.885155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.885310 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.885457 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.885457 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.885881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.886044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.886200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.886356 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.886513 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.886660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.886821 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.886975 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.887130 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.887277 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.887433 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.887596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.887757 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.887905 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.888051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.888197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.888387 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.888551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.888925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.889080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.889228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.889375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.889537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.889686 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.889840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.890128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.890304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.890472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.890729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.890905 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.891062 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.891209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.891638 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.891793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.891963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.892123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.892279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.892470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.892619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.892779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.892947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.893168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.893168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.893474 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.893630 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.893787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.893935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.894081 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.894235 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.894383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.894536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.894697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.894845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.894994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.895140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.895298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.895446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.895602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.895794 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.896028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.896274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.896510 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.896674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.896856 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.897154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.897313 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.897462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.897610 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.897783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.897933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.898080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.898226 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.898372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.898526 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.898684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.899076 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.899239 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.899388 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.899544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.899694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.900040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.900187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.900322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.900445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.907228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.907411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.907558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.907752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.907903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.908045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.908186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.908421 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.908558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.908690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.908837 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.908837 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.909356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.909504 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.909646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.909779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.909910 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.910042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.910182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.910324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.910464 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.910605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.910738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.910888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.911124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.911263 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.911403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.911559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.911984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.912171 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.912339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.912476 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.912622 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.912764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.912905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.913045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.913189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.913189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.913189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.913665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.913815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.913953 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.914096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.914231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.914373 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.914515 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.914657 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.914799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.914933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.915075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.915209 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.915349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.915483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.915624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.915767 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.915940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.916073 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.916288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.916455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.916604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.916738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.916877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917431 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.917968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.918117 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.918250 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.918384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.918518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.918650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.918782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.918924 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.919073 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.919402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.919544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.919685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.919833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.919975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.920107 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.920248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.920440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.920593 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.920737 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.920883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.921016 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.921170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.921393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.921530 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.921679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.921835 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.922209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.922344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.922477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.922619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.922763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.922897 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.923029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.923170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.923303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.923457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.923662 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.923807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.923940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.924073 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.924205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.924371 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.924371 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.924639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.924780 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.924920 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.925112 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.925285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.925403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.925544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.925685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.925820 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.926002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.926136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.926291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.926487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.926631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.926772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.926916 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.927049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.927180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.927321 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.927975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.928120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.928263 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.928427 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.928571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.928695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.928818 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.928818 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.929057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.929175 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.929508 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.929643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.929643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.929879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930635 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930878 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.930971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931164 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931235 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931305 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931547 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.931964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.932199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.932338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.932460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.932635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.932804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.932945 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933078 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933608 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.933878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.934130 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.934263 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.934556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.934715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.934715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.934963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.935102 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.935243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.935382 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.935382 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.935637 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.935775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.935775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.936042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.936186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.936354 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.936500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.936500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.936803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.936947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.937079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.937219 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.937219 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.937490 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.937636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.937781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.937921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938198 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938198 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938457 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938834 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.938972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.939111 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.939253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.939397 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.939537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.939537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.939802 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.939950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940493 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940777 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.940917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.941176 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.941305 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.941305 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.941571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.941703 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.941703 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.941957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.942087 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.942225 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.942365 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.942365 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.942712 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.942918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.942918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.943756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.943907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944046 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.944888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.945142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.945280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.945423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.945554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.945693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.945824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.945967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946097 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946374 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.946907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.947170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.947310 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.947441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.947572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.947572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.947843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.947979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.948107 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.948246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.948246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.948540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.948710 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.948710 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.948944 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.949076 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.949206 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.949350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.949350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.949606 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.949746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.949746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950321 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950849 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.950981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.951120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.951120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.951366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.951504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.951504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.951772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.951918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.952050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.952188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.952188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.952500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.952631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.952631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.952887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953412 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.953937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954076 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954468 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954750 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.954882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.955146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.955279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.955279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.955531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.955653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.955653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.959198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.961064 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.961237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.961383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.961383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.961650 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.961786 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.961786 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962105 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962278 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962278 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962816 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.962956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.963204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.963334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.963334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.963602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.963752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.963896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964040 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964040 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964750 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.964880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.965135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.965366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.965502 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.965641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.965641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.965912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.966053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.966053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.966320 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.966498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.966642 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.966775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.966775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967033 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967164 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967294 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967699 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.967961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.968091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.968221 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.968395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.968537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.968669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.968799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.968938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.969078 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.969223 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.969356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.969494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.969727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.969869 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970287 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970427 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.970867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.971305 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.971440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.971571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.971571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.971839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.971973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972664 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.972935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.973190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.973328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.973467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.973606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.973606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.973915 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.974063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.974204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.974362 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.974362 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.974617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.974749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.974749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975012 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975414 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975414 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975822 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.975960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.976098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.976098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.976408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.976550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.976550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.976813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.976951 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.977089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.977222 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.977222 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.977491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.977628 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.977628 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.977873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978011 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978285 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978285 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.978967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.979222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.979360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.979360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.979623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.979776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.979990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.980148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.980148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.980413 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.980547 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.980547 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.980776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.980958 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.981104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.981318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.981318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.981656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.981787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.981787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982578 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.982838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983513 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983513 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983769 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983901 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.983901 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.984145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.984276 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.984534 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.984682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.984682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.984931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.985654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.985654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.985874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.985987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.985987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986163 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986252 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986252 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986414 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986700 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986700 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.986959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987825 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.987909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.988084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.988178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.988264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.988367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.988454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.988539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.993328 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.993484 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.993625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.993749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.993870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.993992 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.994200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.994328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.994455 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.994573 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.994699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.994816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.994941 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995309 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121221) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.995426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.996862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.996862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.996862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 18:03:09.996862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121220) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 18:03:10.055993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO dbcounter [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Registered counter for database nova_api Sep 01 18:03:10.063969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Registered counter for database nova_api Sep 01 18:03:10.077022 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_db.sqlalchemy.engines [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.083989 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writer thread running {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.085052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.091548 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.140802 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.context [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b184ec90-bfcf-4d57-9534-1fd348f70a38(cell1) {{(pid=121220) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 18:03:10.144892 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:03:10.145384 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:03:10.147095 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:03:10.148059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:03:10.148551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:03:10.149545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.context [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b184ec90-bfcf-4d57-9534-1fd348f70a38(cell1) {{(pid=121221) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 18:03:10.150538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:03:10.152705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO dbcounter [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Registered counter for database nova_cell0 Sep 01 18:03:10.155125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:03:10.155624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:03:10.157104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO dbcounter [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Registered counter for database nova_cell1 Sep 01 18:03:10.157221 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:03:10.157964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:03:10.158421 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:03:10.160516 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:03:10.163083 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Registered counter for database nova_cell0 Sep 01 18:03:10.166270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_db.sqlalchemy.engines [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.167444 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Registered counter for database nova_cell1 Sep 01 18:03:10.167671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_db.sqlalchemy.engines [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.172404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writer thread running {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.174904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.175678 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writer thread running {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.177252 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.183046 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.188334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.325537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO dbcounter [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Registered counter for database nova_cell0 Sep 01 18:03:10.332192 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_db.sqlalchemy.engines [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121220) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.334882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO dbcounter [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Registered counter for database nova_cell0 Sep 01 18:03:10.336691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writer thread running {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.341330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_db.sqlalchemy.engines [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121221) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 18:03:10.345732 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writer thread running {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 18:03:10.655264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: WARNING keystonemiddleware.auth_token [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 18:03:10.661401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 18:03:10.663768 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: WARNING keystonemiddleware.auth_token [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 18:03:10.669395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 18:03:11.015360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 18:03:11.015957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: WARNING keystonemiddleware.auth_token [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 18:03:11.021356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: WARNING keystonemiddleware.auth_token [None req-b34a2371-5644-4ded-b250-5d71f6cd81b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 18:03:11.021712 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: WARNING keystonemiddleware.auth_token [None req-a67a39b0-1e3e-4c07-b7a7-7c42ae5e68dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 18:03:11.027037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556b810989c0 pid: 121220 (default app) Sep 01 18:03:11.027167 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556b810989c0 pid: 121221 (default app) Sep 01 18:03:45.515467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:45.516421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:45.520796 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:45.521751 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:46.786221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-08f8233d-6f8b-4cd4-ac14-05119a471c99 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Action: 'create', calling method: .version_select at 0x7f446b798280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2023049369"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:03:47.819528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:47.820714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:47.821591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:47.822469 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:03:48.627720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-08f8233d-6f8b-4cd4-ac14-05119a471c99 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.126917 Sep 01 18:03:48.640389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1155 bytes} [Thu Sep 1 18:03:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3135 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 01 18:03:48.653647 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fd9b881b-f1c6-4be0-825a-388d12328c43 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67f160>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:48.836141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fd9b881b-f1c6-4be0-825a-388d12328c43 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a" status: 200 len: 345 microversion: 2.1 time: 0.192498 Sep 01 18:03:48.837464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:48 2022] GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:03:49.272088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-de1bfe9c-719b-4d80-92f1-fe54bbb6be75 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Action: 'create', calling method: .version_select at 0x7f446b7961f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1736733210", "metadata": {"Type": "work"}}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:03:49.864267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-92627adf-eb45-4210-b610-c8f344a6330b tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67f820>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:50.502474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-92627adf-eb45-4210-b610-c8f344a6330b tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a" status: 200 len: 346 microversion: 2.1 time: 0.615396 Sep 01 18:03:50.502474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 3/3] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:49 2022] GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a => generated 346 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:03:50.502474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b35951fc-20e5-4cbc-ab96-ede29b5e5525 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Action: 'create', calling method: .version_select at 0x7f446b67fe50>, body: {"snapshot": {"volume_id": "49386720-c9ce-4751-aa5e-c21559371c5a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-700032887"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:03:51.169519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-de1bfe9c-719b-4d80-92f1-fe54bbb6be75 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.355550 Sep 01 18:03:51.170257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 1/4] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 1 18:03:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3358 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 18:03:51.187682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-69da102f-86f7-4e22-8eef-2170e4492bee tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67d0d0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:51.328401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-69da102f-86f7-4e22-8eef-2170e4492bee tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 353 microversion: 2.1 time: 0.144836 Sep 01 18:03:51.329408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 2/5] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:51 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:51.654987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d373d960-6ee9-4073-a6e5-1b5f58881b48 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446b67d790>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:51.677246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b35951fc-20e5-4cbc-ab96-ede29b5e5525 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.205378 Sep 01 18:03:51.677821 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 4/6] 10.222.0.15 () {60 vars in 1162 bytes} [Thu Sep 1 18:03:50 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:51.688909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-993d571f-52ba-4e50-90a5-b5e2da82a07c tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67fb80>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:51.856406 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d373d960-6ee9-4073-a6e5-1b5f58881b48 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/5e61c619-ad90-41f6-b64f-f94b94067c32" status: 200 len: 350 microversion: 2.1 time: 0.205081 Sep 01 18:03:51.857326 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:51 2022] GET /compute/v2.1/os-volumes/5e61c619-ad90-41f6-b64f-f94b94067c32 => generated 350 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:03:52.093460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-993d571f-52ba-4e50-90a5-b5e2da82a07c tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.408801 Sep 01 18:03:52.094665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:51 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:52.105206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0bc9a3e3-aad7-402c-9882-f88aed2649e5 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67de50>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:52.236991 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0bc9a3e3-aad7-402c-9882-f88aed2649e5 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.135446 Sep 01 18:03:52.238301 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 4/9] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Sep 1 18:03:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:52.258619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8329031d-5680-481f-89a9-13b8519cac7e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67f430>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:52.310579 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8329031d-5680-481f-89a9-13b8519cac7e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.064049 Sep 01 18:03:52.311786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 6/10] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:52 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:52.343195 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a1967156-5418-4bd8-9b41-a148c63b3111 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67dd30>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:52.472104 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a1967156-5418-4bd8-9b41-a148c63b3111 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 354 microversion: 2.1 time: 0.132819 Sep 01 18:03:52.473519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 5/11] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:52 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:52.506137 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0ef53d66-2751-4009-8e59-af42b985cdf1 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b66af70>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:52.595036 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0ef53d66-2751-4009-8e59-af42b985cdf1 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 354 microversion: 2.1 time: 0.095125 Sep 01 18:03:52.596399 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:52 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:52.610032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3a9a2796-611d-4a01-8fc7-9cea7bda954e tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67d550>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:52.939280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3a9a2796-611d-4a01-8fc7-9cea7bda954e tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 202 len: 0 microversion: 2.1 time: 0.330106 Sep 01 18:03:52.939919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:03:52 2022] DELETE /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:03:52.949855 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-af96f20e-477b-4d4e-a888-0bccab23ad9b tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67f1f0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:53.126188 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-af96f20e-477b-4d4e-a888-0bccab23ad9b tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 353 microversion: 2.1 time: 0.181499 Sep 01 18:03:53.132609 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:52 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:53.323816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1e1d4c70-8764-4d20-813b-349fc49cd872 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b796ee0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:53.392274 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1e1d4c70-8764-4d20-813b-349fc49cd872 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.072859 Sep 01 18:03:53.398322 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:53 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:54.140025 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3fc77d51-f405-49e1-8bb3-d65cab482a6c tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67f9d0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:54.245264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3fc77d51-f405-49e1-8bb3-d65cab482a6c tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 353 microversion: 2.1 time: 0.108923 Sep 01 18:03:54.246773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:54 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:54.406100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-034f29be-d57c-409f-a2ab-82364a6e3d09 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67d280>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:54.472934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-034f29be-d57c-409f-a2ab-82364a6e3d09 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.057811 Sep 01 18:03:54.472934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:54 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:55.260521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-490059b5-669d-40ba-bfa8-e0f179bd8917 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b798dc0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:55.345348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-490059b5-669d-40ba-bfa8-e0f179bd8917 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 353 microversion: 2.1 time: 0.088760 Sep 01 18:03:55.346225 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:55 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:55.474211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-db96ff82-52a7-41e9-b6ba-fa4e87a5b2ab tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67d9d0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:55.526797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-db96ff82-52a7-41e9-b6ba-fa4e87a5b2ab tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.057364 Sep 01 18:03:55.527543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 9/19] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:55 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:56.365377 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-35939ff5-6f56-446f-9cf3-2c222c4f5db2 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b607790>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:56.513872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-35939ff5-6f56-446f-9cf3-2c222c4f5db2 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 353 microversion: 2.1 time: 0.156173 Sep 01 18:03:56.513872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 11/20] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:56 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:56.544745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b6ed6214-9910-4f87-88fd-f862d1985f13 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b796dc0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:56.590340 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b6ed6214-9910-4f87-88fd-f862d1985f13 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.053784 Sep 01 18:03:56.592072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 10/21] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:56 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:57.529880 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-014e7cc3-ffa0-4a04-9ada-42cdb7c262e1 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67fee0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:57.604519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0b71ebf2-3c95-4d52-bf33-d2e2a236f260 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67dee0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:57.695383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-014e7cc3-ffa0-4a04-9ada-42cdb7c262e1 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 353 microversion: 2.1 time: 0.172784 Sep 01 18:03:57.695953 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:57 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:57.699129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0b71ebf2-3c95-4d52-bf33-d2e2a236f260 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.097729 Sep 01 18:03:57.699693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:57 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:03:58.712554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5dbec6fe-e304-40dd-ac26-8cf66094667e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67f550>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:58.720812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-01875909-585d-4566-9e61-c6abddffa338 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67d670>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:58.823261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5dbec6fe-e304-40dd-ac26-8cf66094667e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 287 microversion: 2.1 time: 0.115707 Sep 01 18:03:58.823893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 13/24] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:58 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:58.837296 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-522f9429-1279-40fc-b5f0-c5743b34b850 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67f040>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:58.923561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-01875909-585d-4566-9e61-c6abddffa338 tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 200 len: 353 microversion: 2.1 time: 0.218194 Sep 01 18:03:58.924133 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:58 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:59.183723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-522f9429-1279-40fc-b5f0-c5743b34b850 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 202 len: 0 microversion: 2.1 time: 0.351386 Sep 01 18:03:59.184714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 14/26] 10.222.0.15 () {58 vars in 1254 bytes} [Thu Sep 1 18:03:58 2022] DELETE /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:03:59.200302 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2281d1f7-e176-4ad7-9f5f-c5184677f5ee tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b67d160>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:59.307435 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2281d1f7-e176-4ad7-9f5f-c5184677f5ee tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 200 len: 286 microversion: 2.1 time: 0.111398 Sep 01 18:03:59.308008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:03:59 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:59.749966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-adc0b6b3-eb62-4dd0-a5c5-725ad1f4e384 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446b606820>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:03:59.878527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-adc0b6b3-eb62-4dd0-a5c5-725ad1f4e384 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e273d2af-8a16-4115-82cd-239dfca2a4e0" status: 200 len: 351 microversion: 2.1 time: 0.132291 Sep 01 18:03:59.887275 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 14/28] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:59 2022] GET /compute/v2.1/os-volumes/e273d2af-8a16-4115-82cd-239dfca2a4e0 => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:03:59.938593 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3c6e938a-b414-4ae4-af77-0e228132ff7b tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Calling method '.version_select at 0x7f446b67d3a0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:00.005377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-3c6e938a-b414-4ae4-af77-0e228132ff7b tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] HTTP exception thrown: Volume fd3abbcc-2712-4568-9ab4-dfab4fdfef7f could not be found. Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3c6e938a-b414-4ae4-af77-0e228132ff7b tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Request method failure captured: Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f HTTP/1.1 Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQD6AhRIyZPr-ktd6Ow_UXHft_dJBOXxYO05nuGrbb1Ru3dgvtP1bPzUrefummL9vqcwWR0WECqfR8ttjprArj9szowSrezt9LXCC97RveanYBUNPO_BPRCNyracCLPFBRvVRD4UFa-1iy2MrjICeFU4wUSMJqUZxDc44_zeWkYfh8 Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 7f83480b456d4c9f8fe4a74f3b81f6e3 Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesGetTestJSON-1057990702 Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:04:00.015028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7f83480b456d4c9f8fe4a74f3b81f6e3", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7f83480b456d4c9f8fe4a74f3b81f6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7f83480b456d4c9f8fe4a74f3b81f6e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7f83480b456d4c9f8fe4a74f3b81f6e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesGetTestJSON-1057990702 Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 7f83480b456d4c9f8fe4a74f3b81f6e3 Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesGetTestJSON-1057990702 Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesGetTestJSON-1057990702-project Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 4911fa3dc5264eceb36f2601830cca81 Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesGetTestJSON-1057990702-project Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Volume fd3abbcc-2712-4568-9ab4-dfab4fdfef7f could not be found. Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'fd3abbcc-2712-4568-9ab4-dfab4fdfef7f'} Sep 01 18:04:00.019331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd3abbcc-2712-4568-9ab4-dfab4fdfef7f could not be found. (HTTP 404) (Request-ID: req-94d7fbaf-2a09-4d3e-9e90-f5c515c6d520) Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:00.020567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:00.021592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd3abbcc-2712-4568-9ab4-dfab4fdfef7f could not be found. Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 18:04:00.022864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd3abbcc-2712-4568-9ab4-dfab4fdfef7f could not be found. Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd3abbcc-2712-4568-9ab4-dfab4fdfef7f could not be found. Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3c6e938a-b414-4ae4-af77-0e228132ff7b tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] Returning 404 to user: Volume fd3abbcc-2712-4568-9ab4-dfab4fdfef7f could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3c6e938a-b414-4ae4-af77-0e228132ff7b tempest-VolumesGetTestJSON-1057990702 tempest-VolumesGetTestJSON-1057990702-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f" status: 404 len: 109 microversion: 2.1 time: 0.084033 Sep 01 18:04:00.024233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 15/29] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:03:59 2022] GET /compute/v2.1/os-volumes/fd3abbcc-2712-4568-9ab4-dfab4fdfef7f => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:04:00.571815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-681f4f39-daae-446b-ad46-2ca7f7ab5f07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'create', calling method: .version_select at 0x7f446b607a60>, body: {"keypair": {"name": "tempest-keypair-1735506503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy8Qgz/OZaFRnmWP5SvmjHrE7QZXgiowfkWhTXuVrdzG4QTe6R5l9LjxO7dq+T1JD2gOyv+wjht+9+AxvaYrrxIqGMWxOWEK57uLVM1V58ukj8P/fGqf75sDG0ML2kbAg=="}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:00.631507 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-681f4f39-daae-446b-ad46-2ca7f7ab5f07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for project b40443d415fa40338b837dd445032342. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:04:00.638854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-681f4f39-daae-446b-ad46-2ca7f7ab5f07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for user fb6a740de8b9417b89afb08f230aa4b7 and project b40443d415fa40338b837dd445032342. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:04:00.698435 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-390954960", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "networks": [{"uuid": "19b974fb-4a8e-462f-af2a-6a22a88cb1f0"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:00.807478 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-681f4f39-daae-446b-ad46-2ca7f7ab5f07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.087856 Sep 01 18:04:00.808767 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 15/30] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Sep 1 18:03:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1092 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 18:04:00.815953 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b80e057d-590e-4cc1-8cfa-8703c7813d15 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b590160>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:00.841823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] validate_networks() for [('19b974fb-4a8e-462f-af2a-6a22a88cb1f0', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:04:00.868432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-b80e057d-590e-4cc1-8cfa-8703c7813d15 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] HTTP exception thrown: Snapshot d89c4159-fc21-4a06-8b22-d43c3d7c54d9 could not be found. Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b80e057d-590e-4cc1-8cfa-8703c7813d15 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Request method failure captured: Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 HTTP/1.1 Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQB-QWSNO0HDYrjN2bvZGKTu8AKTB9fgFBCudzqf3A-X6xTXJw-wybaatE9oIVYqLPfq2gNaaNfbTM9t8ktl8EAG93iVP2fT-550RiYeJ8adhhrRcQh5vU5ypvlmLjODXZyLbpXTS6EUdXOtoiCpf2rRRrqPHJpgXdgHcFn4DxOiuo Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:04:00.897718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6aae701e8155487b8a50d7300642ee56", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: e26cbd3dcec948f69529a9541bb33ce1 Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Snapshot d89c4159-fc21-4a06-8b22-d43c3d7c54d9 could not be found. Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'd89c4159-fc21-4a06-8b22-d43c3d7c54d9'} Sep 01 18:04:00.899040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d89c4159-fc21-4a06-8b22-d43c3d7c54d9 could not be found. (HTTP 404) (Request-ID: req-39818d1e-9f0c-49a3-b1b4-83f3cedee362) Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.899911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:00.901217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d89c4159-fc21-4a06-8b22-d43c3d7c54d9 could not be found. Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 18:04:00.902308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d89c4159-fc21-4a06-8b22-d43c3d7c54d9 could not be found. Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d89c4159-fc21-4a06-8b22-d43c3d7c54d9 could not be found. Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b80e057d-590e-4cc1-8cfa-8703c7813d15 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Returning 404 to user: Snapshot d89c4159-fc21-4a06-8b22-d43c3d7c54d9 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b80e057d-590e-4cc1-8cfa-8703c7813d15 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9" status: 404 len: 111 microversion: 2.1 time: 0.082665 Sep 01 18:04:00.904506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 16/31] 10.222.0.15 () {58 vars in 1251 bytes} [Thu Sep 1 18:04:00 2022] GET /compute/v2.1/os-snapshots/d89c4159-fc21-4a06-8b22-d43c3d7c54d9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:04:00.909809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f08fc9a3-3501-44f3-87d2-f77a83b7097b tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b574670>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:01.190230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f08fc9a3-3501-44f3-87d2-f77a83b7097b tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a" status: 202 len: 0 microversion: 2.1 time: 0.288662 Sep 01 18:04:01.190230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:04:00 2022] DELETE /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:04:01.207874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-427c98a5-2722-4b8b-9806-93d661436f1c tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b574dc0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:01.286976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-427c98a5-2722-4b8b-9806-93d661436f1c tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a" status: 200 len: 345 microversion: 2.1 time: 0.092974 Sep 01 18:04:01.287914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 18/33] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:04:01 2022] GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:01.929848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-937892348", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:02.187545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] validate_networks() for [('d6f1c66b-8614-4e3c-b35f-b4f9c8f42a21', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:04:03.025608 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:04:03.026074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:04:03.026509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:04:03.026922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:04:03.027435 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:04:03.069539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:03.070024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:03.070462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:03.071199 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:03.071652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:03.072078 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:03.188365 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Getting quotas for project 62c83a25c5f74e3396ebe8b0a3ee580e. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:04:03.206269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Getting quotas for user af540344a27b48eba16db2861df2078b and project 62c83a25c5f74e3396ebe8b0a3ee580e. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:04:03.239629 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:04:03.255503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:04:03.494880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5d7f0eb7-e058-4113-b35a-76edd2f090a5 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.470978 Sep 01 18:04:03.495457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 16/34] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:04:03.510347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-43f497f1-229e-488f-b5b3-d9af569fdd9e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b4ece50>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:03.991008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-43f497f1-229e-488f-b5b3-d9af569fdd9e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] HTTP exception thrown: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-43f497f1-229e-488f-b5b3-d9af569fdd9e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Request method failure captured: Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a HTTP/1.1 Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQB-QWSNO0HDYrjN2bvZGKTu8AKTB9fgFBCudzqf3A-X6xTXJw-wybaatE9oIVYqLPfq2gNaaNfbTM9t8ktl8EAG93iVP2fT-550RiYeJ8adhhrRcQh5vU5ypvlmLjODXZyLbpXTS6EUdXOtoiCpf2rRRrqPHJpgXdgHcFn4DxOiuo Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:04:03.995000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6aae701e8155487b8a50d7300642ee56", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: e26cbd3dcec948f69529a9541bb33ce1 Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '49386720-c9ce-4751-aa5e-c21559371c5a'} Sep 01 18:04:04.004555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. (HTTP 404) (Request-ID: req-3eefc834-e93e-4773-9830-e2320b6ab308) Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.006370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:04.007600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 18:04:04.010655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-43f497f1-229e-488f-b5b3-d9af569fdd9e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Returning 404 to user: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-43f497f1-229e-488f-b5b3-d9af569fdd9e tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a" status: 404 len: 109 microversion: 2.1 time: 0.501567 Sep 01 18:04:04.012042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 17/35] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:04:03 2022] GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a => generated 109 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:04:04.026339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1ddb3a3a-3689-4410-9950-b6ab34ce4876 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:04.034716 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1ddb3a3a-3689-4410-9950-b6ab34ce4876 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:04.154272 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:04:04.158254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:04:04.158254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:04:04.158254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:04:04.158254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:04:04.170181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:04.171102 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:04.171762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:04.172742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:04.173566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:04.174703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:04.209646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for project 6749f998c37a43428eb7e1233408c560. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:04:04.228857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for user 01f1499bbf89441dae30433aaf1d29a7 and project 6749f998c37a43428eb7e1233408c560. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:04:04.281208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1ddb3a3a-3689-4410-9950-b6ab34ce4876 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:04.294531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:04:04.297462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:04:04.317097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1ddb3a3a-3689-4410-9950-b6ab34ce4876 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1214 microversion: 2.1 time: 0.314276 Sep 01 18:04:04.317097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 18/36] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:03 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1214 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:04.333151 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-22aabbbb-3e98-489b-877b-dd220c9f0607 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b501ee0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-22aabbbb-3e98-489b-877b-dd220c9f0607 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] HTTP exception thrown: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-22aabbbb-3e98-489b-877b-dd220c9f0607 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Request method failure captured: Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a HTTP/1.1 Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQB-QWSNO0HDYrjN2bvZGKTu8AKTB9fgFBCudzqf3A-X6xTXJw-wybaatE9oIVYqLPfq2gNaaNfbTM9t8ktl8EAG93iVP2fT-550RiYeJ8adhhrRcQh5vU5ypvlmLjODXZyLbpXTS6EUdXOtoiCpf2rRRrqPHJpgXdgHcFn4DxOiuo Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:04:04.439169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6aae701e8155487b8a50d7300642ee56", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: e26cbd3dcec948f69529a9541bb33ce1 Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '49386720-c9ce-4751-aa5e-c21559371c5a'} Sep 01 18:04:04.440792 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. (HTTP 404) (Request-ID: req-3223b281-518c-4d8f-b8f1-13553acccf45) Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.442173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 18:04:04.443170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 18:04:04.445859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-22aabbbb-3e98-489b-877b-dd220c9f0607 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Returning 404 to user: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-22aabbbb-3e98-489b-877b-dd220c9f0607 tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a" status: 404 len: 109 microversion: 2.1 time: 0.110943 Sep 01 18:04:04.448281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 19/37] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:04:04 2022] DELETE /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:04:04.450173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-49d446a2-31c3-4544-8b2c-7a3f0e740b9c tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446aca2550>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:04.591015 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8d475024-00b4-4fae-927a-8f2204ea1238 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.199511 Sep 01 18:04:04.611056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 19/38] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:04:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:04:04.621591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-49d446a2-31c3-4544-8b2c-7a3f0e740b9c tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/af062397-9411-4b1c-b270-fe50798fcffb" status: 200 len: 350 microversion: 2.1 time: 0.183606 Sep 01 18:04:04.622591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 20/39] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:04:04 2022] GET /compute/v2.1/os-volumes/af062397-9411-4b1c-b270-fe50798fcffb => generated 350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:04.634213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-59e1bac1-7a43-46c0-93d8-1b413f335a88 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:04.634851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-59e1bac1-7a43-46c0-93d8-1b413f335a88 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:04.658011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9cbb9900-1d82-43e9-baa9-a02f85dfe0bf tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Calling method '.version_select at 0x7f446b49a550>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:04.724584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-9cbb9900-1d82-43e9-baa9-a02f85dfe0bf tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] HTTP exception thrown: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9cbb9900-1d82-43e9-baa9-a02f85dfe0bf tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Request method failure captured: Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a HTTP/1.1 Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQB-QWSNO0HDYrjN2bvZGKTu8AKTB9fgFBCudzqf3A-X6xTXJw-wybaatE9oIVYqLPfq2gNaaNfbTM9t8ktl8EAG93iVP2fT-550RiYeJ8adhhrRcQh5vU5ypvlmLjODXZyLbpXTS6EUdXOtoiCpf2rRRrqPHJpgXdgHcFn4DxOiuo Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:04:04.727956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6aae701e8155487b8a50d7300642ee56", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6aae701e8155487b8a50d7300642ee56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 6aae701e8155487b8a50d7300642ee56 Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-596916422 Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: e26cbd3dcec948f69529a9541bb33ce1 Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesSnapshotsTestJSON-596916422-project Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '49386720-c9ce-4751-aa5e-c21559371c5a'} Sep 01 18:04:04.729152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. (HTTP 404) (Request-ID: req-d6d83eae-60a4-4dc8-bf70-ef64b85b44df) Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.729873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:04.730951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 18:04:04.731891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:04.739576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9cbb9900-1d82-43e9-baa9-a02f85dfe0bf tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] Returning 404 to user: Volume 49386720-c9ce-4751-aa5e-c21559371c5a could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:04.741693 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9cbb9900-1d82-43e9-baa9-a02f85dfe0bf tempest-VolumesSnapshotsTestJSON-596916422 tempest-VolumesSnapshotsTestJSON-596916422-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a" status: 404 len: 109 microversion: 2.1 time: 0.127236 Sep 01 18:04:04.750039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-59e1bac1-7a43-46c0-93d8-1b413f335a88 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:04.762080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:04:04 2022] GET /compute/v2.1/os-volumes/49386720-c9ce-4751-aa5e-c21559371c5a => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:04:04.767711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-59e1bac1-7a43-46c0-93d8-1b413f335a88 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1221 microversion: 2.1 time: 0.144046 Sep 01 18:04:04.768282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 21/41] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:04 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:04.789052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-87fe523a-c338-4af1-a9ce-f1938fcf76d5 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446b4af310>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:04.921286 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-87fe523a-c338-4af1-a9ce-f1938fcf76d5 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.157219 Sep 01 18:04:04.922856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Sep 1 18:04:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:04.941929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3891a0d9-3d01-4dd8-9d11-8bef7fac542f tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446aca24c0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:05.089613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3891a0d9-3d01-4dd8-9d11-8bef7fac542f tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.142754 Sep 01 18:04:05.089613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1149 bytes} [Thu Sep 1 18:04:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:05.094583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fb79c878-425c-4299-bf79-aef08d195f57 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446acb43a0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:05.394131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fb79c878-425c-4299-bf79-aef08d195f57 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.303334 Sep 01 18:04:05.395593 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 23/44] 10.222.0.15 () {58 vars in 1134 bytes} [Thu Sep 1 18:04:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:05.411968 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1779856814", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:05.525123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] validate_networks() for [('d6f1c66b-8614-4e3c-b35f-b4f9c8f42a21', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:04:05.865763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f45f903e-7682-477f-8429-053cdae27c9c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Action: 'create', calling method: .version_select at 0x7f446b49a040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-597492545", "metadata": {"Type": "work"}}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f45f903e-7682-477f-8429-053cdae27c9c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Request method failure captured: Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 121 Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQUEecjjH6a4R6Cxl4_aW-4DZ-m_xUu4kUP9jGaIgenXI2pQMx_AHC67yRk4gX7PhMd1uw_HEG-yz6xhgVgT116eOWIfx7jaJBl6x5nBRHBGmAu5GYKuYFwJ5wHvnXPzJe0T9qvuj1yjMIV6cXcBA3s3p0OgcVcwE6ip3gFsAn3EzU Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:04:05.883790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0164a8160f8461988819f82476c4b8d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: a1788edcc6ef4fa8a75e1b932ced7a7b Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-597492545", "metadata": {"Type": "work"}}} Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: Sep 01 18:04:05.889425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-597492545', 'metadata': {'Type': 'work'}}}} Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise error Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:05.890564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 18:04:05.891874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 18:04:05.893353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 18:04:05.893353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:05.893353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f45f903e-7682-477f-8429-053cdae27c9c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:05.893353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f45f903e-7682-477f-8429-053cdae27c9c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.859342 Sep 01 18:04:05.893353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 1 18:04:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 863 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:04:05.903822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4b3ba148-6c58-4f82-89b9-e871362d8e2a tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:05.904482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4b3ba148-6c58-4f82-89b9-e871362d8e2a tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:06.063079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4b3ba148-6c58-4f82-89b9-e871362d8e2a tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:06.083057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4b3ba148-6c58-4f82-89b9-e871362d8e2a tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1214 microversion: 2.1 time: 0.193605 Sep 01 18:04:06.084304 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 23/46] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:05 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:06.112437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d4440ce4-44b4-4187-a3b7-d59b082922d1 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446b4af3a0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:06.391619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:04:06.392121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:04:06.392545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:04:06.392994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:04:06.393424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:04:06.447731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:06.448244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:06.448717 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:06.452766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:06.453402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:06.453862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:06.505202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for project 6749f998c37a43428eb7e1233408c560. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:04:06.510450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for user 01f1499bbf89441dae30433aaf1d29a7 and project 6749f998c37a43428eb7e1233408c560. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:04:06.533868 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:04:06.533868 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:04:06.549479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d4440ce4-44b4-4187-a3b7-d59b082922d1 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.463606 Sep 01 18:04:06.550229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 24/47] 10.222.0.15 () {58 vars in 1167 bytes} [Thu Sep 1 18:04:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:06.556507 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-74a80703-9dce-4e07-a892-ea22fdcecc2a tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Action: 'create', calling method: .version_select at 0x7f446ac78670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1637439819", "metadata": {"Type": "work"}}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-74a80703-9dce-4e07-a892-ea22fdcecc2a tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Request method failure captured: Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 120 Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQUEecjjH6a4R6Cxl4_aW-4DZ-m_xUu4kUP9jGaIgenXI2pQMx_AHC67yRk4gX7PhMd1uw_HEG-yz6xhgVgT116eOWIfx7jaJBl6x5nBRHBGmAu5GYKuYFwJ5wHvnXPzJe0T9qvuj1yjMIV6cXcBA3s3p0OgcVcwE6ip3gFsAn3EzU Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:04:06.570067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0164a8160f8461988819f82476c4b8d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: a1788edcc6ef4fa8a75e1b932ced7a7b Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1637439819", "metadata": {"Type": "work"}}} Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: Sep 01 18:04:06.571485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1637439819', 'metadata': {'Type': 'work'}}}} Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise error Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi '0' Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:06.572359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 18:04:06.573730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 18:04:06.575140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 18:04:06.575140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:06.576849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-74a80703-9dce-4e07-a892-ea22fdcecc2a tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:06.577826 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-74a80703-9dce-4e07-a892-ea22fdcecc2a tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025666 Sep 01 18:04:06.580005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 25/48] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 1 18:04:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:04:06.597330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-538579177", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b0ca8af-c9fa-4c03-8352-34ec8782c36f"}], "security_groups": [{"name": "tempest-securitygroup--62517574"}], "key_name": "tempest-keypair-1735506503", "user_data": "}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:06.880412 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2c4b33ae-96c0-4ad7-addf-3a7427ed2b5f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.474695 Sep 01 18:04:06.881330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:04:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:04:06.886341 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c474e45f-630d-4dac-88cd-bc4b7889bd87 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446acb45e0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:06.918981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] validate_networks() for [('4b0ca8af-c9fa-4c03-8352-34ec8782c36f', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:04:07.115377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c474e45f-630d-4dac-88cd-bc4b7889bd87 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.232599 Sep 01 18:04:07.116637 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1170 bytes} [Thu Sep 1 18:04:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:07.134339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1864399e-bafe-4371-a3ed-061d24833912 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Action: 'create', calling method: .version_select at 0x7f446acb48b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-219507277", "metadata": {"Type": "work"}}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1864399e-bafe-4371-a3ed-061d24833912 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Request method failure captured: Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 118 Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQUEecjjH6a4R6Cxl4_aW-4DZ-m_xUu4kUP9jGaIgenXI2pQMx_AHC67yRk4gX7PhMd1uw_HEG-yz6xhgVgT116eOWIfx7jaJBl6x5nBRHBGmAu5GYKuYFwJ5wHvnXPzJe0T9qvuj1yjMIV6cXcBA3s3p0OgcVcwE6ip3gFsAn3EzU Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:04:07.147742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0164a8160f8461988819f82476c4b8d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: a1788edcc6ef4fa8a75e1b932ced7a7b Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-219507277", "metadata": {"Type": "work"}}} Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: Sep 01 18:04:07.149328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-219507277', 'metadata': {'Type': 'work'}}}} Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise error Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi '' Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:07.150174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 18:04:07.151586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 18:04:07.152881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 18:04:07.152881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.158728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1864399e-bafe-4371-a3ed-061d24833912 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:07.159616 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1864399e-bafe-4371-a3ed-061d24833912 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035872 Sep 01 18:04:07.163502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1156 bytes} [Thu Sep 1 18:04:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:04:07.181947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8606cca0-cbb9-4f93-851b-1bf03c887cef tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:07.183018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8606cca0-cbb9-4f93-851b-1bf03c887cef tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:07.308386 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8606cca0-cbb9-4f93-851b-1bf03c887cef tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:07.327595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8606cca0-cbb9-4f93-851b-1bf03c887cef tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1222 microversion: 2.1 time: 0.162983 Sep 01 18:04:07.345985 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 27/52] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:07 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:07.356969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:07.357974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:07.367509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:07.368349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:07.368975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:07.369840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:07.370980 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:07.372428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:07.606555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:07.622163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-03e85971-64f2-45a3-be71-c1b138e47056 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1218 microversion: 2.1 time: 0.274776 Sep 01 18:04:07.625905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 28/53] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:07 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:07.632028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96ad5766-c428-4d70-bd02-450bc1212e08 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446abcd3a0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:07.792729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96ad5766-c428-4d70-bd02-450bc1212e08 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.165501 Sep 01 18:04:07.793579 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 29/54] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Sep 1 18:04:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:07.808300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:04:07.808593 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-05465d9f-15e7-4803-ba38-671de61aca4c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Calling method '.version_select at 0x7f446abcde50>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:07.809362 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:04:07.810691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:04:07.811343 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:04:07.812300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:04:07.852112 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:07.852743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:07.853315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:07.854047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:07.854676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:07.855288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:07.862940 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-05465d9f-15e7-4803-ba38-671de61aca4c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] HTTP exception thrown: Volume tempest-invalid-1424959528 could not be found. Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-05465d9f-15e7-4803-ba38-671de61aca4c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Request method failure captured: Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1424959528 HTTP/1.1 Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQUEecjjH6a4R6Cxl4_aW-4DZ-m_xUu4kUP9jGaIgenXI2pQMx_AHC67yRk4gX7PhMd1uw_HEG-yz6xhgVgT116eOWIfx7jaJBl6x5nBRHBGmAu5GYKuYFwJ5wHvnXPzJe0T9qvuj1yjMIV6cXcBA3s3p0OgcVcwE6ip3gFsAn3EzU Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:04:07.866139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0164a8160f8461988819f82476c4b8d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: a1788edcc6ef4fa8a75e1b932ced7a7b Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Volume tempest-invalid-1424959528 could not be found. Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'tempest-invalid-1424959528'} Sep 01 18:04:07.867315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1424959528 could not be found. (HTTP 404) (Request-ID: req-13c3d14e-aeeb-400d-9807-c4f552cd0a2a) Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:07.868118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 18:04:07.869180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1424959528 could not be found. Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:07.871110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1424959528 could not be found. Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1424959528 could not be found. Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-05465d9f-15e7-4803-ba38-671de61aca4c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Returning 404 to user: Volume tempest-invalid-1424959528 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-05465d9f-15e7-4803-ba38-671de61aca4c tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1424959528" status: 404 len: 99 microversion: 2.1 time: 0.073064 Sep 01 18:04:07.877972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 30/55] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 1 18:04:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1424959528 => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 18:04:07.879627 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-75e51434-4bcc-4bda-83b2-8b99645f25aa tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446b501ee0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:07.884932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for project b40443d415fa40338b837dd445032342. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:04:07.890163 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for user fb6a740de8b9417b89afb08f230aa4b7 and project b40443d415fa40338b837dd445032342. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:04:07.912370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:04:07.912370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:04:07.975908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-75e51434-4bcc-4bda-83b2-8b99645f25aa tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102131 Sep 01 18:04:07.975908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 31/56] 10.222.0.15 () {58 vars in 1188 bytes} [Thu Sep 1 18:04:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:07.977865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3fabb1a8-e24c-491e-9c0e-98c682a3748a tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004296 Sep 01 18:04:07.982837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 32/57] 10.222.0.15 () {58 vars in 1140 bytes} [Thu Sep 1 18:04:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 18:04:07.990883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8008365c-8afb-47d8-bd7a-080663d6b67a tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006798 Sep 01 18:04:07.993853 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 33/58] 10.222.0.15 () {58 vars in 1137 bytes} [Thu Sep 1 18:04:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 18:04:08.005805 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ae67c3f5-4e11-4ea2-81f4-7bb8f37ca962 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] Calling method '.version_select at 0x7f446abcdaf0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:08.102093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c3944b71-cb25-4d70-b8ba-c2c3f8ad40dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.520543 Sep 01 18:04:08.110115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 26/59] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Sep 1 18:04:06 2022] POST /compute/v2.1/servers => generated 400 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 18:04:08.130319 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2f1db225-ac8c-4137-b9d7-004f4c497a26 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Calling method '.version_select at 0x7f446ac78040>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:08.230895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ae67c3f5-4e11-4ea2-81f4-7bb8f37ca962 tempest-VolumesTestJSON-2100268945 tempest-VolumesTestJSON-2100268945-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.233919 Sep 01 18:04:08.231484 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 34/60] 10.222.0.15 () {58 vars in 1155 bytes} [Thu Sep 1 18:04:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:08.236711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-51f9ed52-bbf0-45aa-8efe-2c4a506735a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:08.237576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-51f9ed52-bbf0-45aa-8efe-2c4a506735a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:08.340740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51f9ed52-bbf0-45aa-8efe-2c4a506735a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:08.362162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51f9ed52-bbf0-45aa-8efe-2c4a506735a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:08.362162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51f9ed52-bbf0-45aa-8efe-2c4a506735a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:08.362162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-51f9ed52-bbf0-45aa-8efe-2c4a506735a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1281 microversion: 2.20 time: 0.129079 Sep 01 18:04:08.365872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 35/61] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:08 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:08.387872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b705b743-f846-4f56-b2f0-f61bd7a96bd3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:08.389635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b705b743-f846-4f56-b2f0-f61bd7a96bd3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:08.406694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-2f1db225-ac8c-4137-b9d7-004f4c497a26 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] HTTP exception thrown: Volume 24e7fbfb-6da6-4454-9610-02f1bcd170a0 could not be found. Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2f1db225-ac8c-4137-b9d7-004f4c497a26 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Request method failure captured: Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: DELETE /compute/v2.1/os-volumes/24e7fbfb-6da6-4454-9610-02f1bcd170a0 HTTP/1.1 Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQUEecjjH6a4R6Cxl4_aW-4DZ-m_xUu4kUP9jGaIgenXI2pQMx_AHC67yRk4gX7PhMd1uw_HEG-yz6xhgVgT116eOWIfx7jaJBl6x5nBRHBGmAu5GYKuYFwJ5wHvnXPzJe0T9qvuj1yjMIV6cXcBA3s3p0OgcVcwE6ip3gFsAn3EzU Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:04:08.409269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0164a8160f8461988819f82476c4b8d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: a1788edcc6ef4fa8a75e1b932ced7a7b Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Volume 24e7fbfb-6da6-4454-9610-02f1bcd170a0 could not be found. Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '24e7fbfb-6da6-4454-9610-02f1bcd170a0'} Sep 01 18:04:08.411086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24e7fbfb-6da6-4454-9610-02f1bcd170a0 could not be found. (HTTP 404) (Request-ID: req-ba9d17db-08b5-440d-a4a8-73aa3c03ac4d) Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:08.411790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 18:04:08.413162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24e7fbfb-6da6-4454-9610-02f1bcd170a0 could not be found. Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 18:04:08.415511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24e7fbfb-6da6-4454-9610-02f1bcd170a0 could not be found. Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24e7fbfb-6da6-4454-9610-02f1bcd170a0 could not be found. Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2f1db225-ac8c-4137-b9d7-004f4c497a26 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Returning 404 to user: Volume 24e7fbfb-6da6-4454-9610-02f1bcd170a0 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2f1db225-ac8c-4137-b9d7-004f4c497a26 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/24e7fbfb-6da6-4454-9610-02f1bcd170a0" status: 404 len: 109 microversion: 2.1 time: 0.298739 Sep 01 18:04:08.417992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 27/62] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:04:08 2022] DELETE /compute/v2.1/os-volumes/24e7fbfb-6da6-4454-9610-02f1bcd170a0 => generated 109 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:04:08.424056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d9ee942f-8a3e-4f68-9fdd-b63db7138b81 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Calling method '.version_select at 0x7f446ac78160>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:08.503660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b705b743-f846-4f56-b2f0-f61bd7a96bd3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:08.511845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b705b743-f846-4f56-b2f0-f61bd7a96bd3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1222 microversion: 2.1 time: 0.144595 Sep 01 18:04:08.516422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 36/63] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:08 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1222 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:08.651455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:08.652542 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:08.725545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:08.725545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:08.725545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:08.725545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:08.725906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:08.725906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:08.839843 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:08.855790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6eba3022-932e-4b9e-bc4b-863a2d3694ed tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1266 microversion: 2.1 time: 0.207270 Sep 01 18:04:08.860604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-d9ee942f-8a3e-4f68-9fdd-b63db7138b81 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] HTTP exception thrown: Volume ee31f977-d8e6-4c15-b075-34e7781d0841 could not be found. Sep 01 18:04:08.860967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 37/64] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:08 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d9ee942f-8a3e-4f68-9fdd-b63db7138b81 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Request method failure captured: Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/os-volumes/ee31f977-d8e6-4c15-b075-34e7781d0841 HTTP/1.1 Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQUEecjjH6a4R6Cxl4_aW-4DZ-m_xUu4kUP9jGaIgenXI2pQMx_AHC67yRk4gX7PhMd1uw_HEG-yz6xhgVgT116eOWIfx7jaJBl6x5nBRHBGmAu5GYKuYFwJ5wHvnXPzJe0T9qvuj1yjMIV6cXcBA3s3p0OgcVcwE6ip3gFsAn3EzU Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:04:08.863574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d0164a8160f8461988819f82476c4b8d", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d0164a8160f8461988819f82476c4b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: d0164a8160f8461988819f82476c4b8d Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesNegativeTest-547453427 Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: a1788edcc6ef4fa8a75e1b932ced7a7b Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesNegativeTest-547453427-project Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Volume ee31f977-d8e6-4c15-b075-34e7781d0841 could not be found. Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'ee31f977-d8e6-4c15-b075-34e7781d0841'} Sep 01 18:04:08.865136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee31f977-d8e6-4c15-b075-34e7781d0841 could not be found. (HTTP 404) (Request-ID: req-ace04090-1890-44cf-8463-152d2f29cccd) Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:08.865864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 18:04:08.866822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee31f977-d8e6-4c15-b075-34e7781d0841 could not be found. Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 18:04:08.867785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee31f977-d8e6-4c15-b075-34e7781d0841 could not be found. Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee31f977-d8e6-4c15-b075-34e7781d0841 could not be found. Sep 01 18:04:08.868844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:04:08.876078 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d9ee942f-8a3e-4f68-9fdd-b63db7138b81 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] Returning 404 to user: Volume ee31f977-d8e6-4c15-b075-34e7781d0841 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:04:08.876978 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d9ee942f-8a3e-4f68-9fdd-b63db7138b81 tempest-VolumesNegativeTest-547453427 tempest-VolumesNegativeTest-547453427-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ee31f977-d8e6-4c15-b075-34e7781d0841" status: 404 len: 109 microversion: 2.1 time: 0.458483 Sep 01 18:04:08.888727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 28/65] 10.222.0.15 () {58 vars in 1245 bytes} [Thu Sep 1 18:04:08 2022] GET /compute/v2.1/os-volumes/ee31f977-d8e6-4c15-b075-34e7781d0841 => generated 109 bytes in 460 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:04:09.391847 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f7581939-47c1-44f6-ab32-c586cc6f1333 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:09.392651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f7581939-47c1-44f6-ab32-c586cc6f1333 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:09.457040 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f7581939-47c1-44f6-ab32-c586cc6f1333 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:09.467200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f7581939-47c1-44f6-ab32-c586cc6f1333 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:09.468895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f7581939-47c1-44f6-ab32-c586cc6f1333 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:09.470097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f7581939-47c1-44f6-ab32-c586cc6f1333 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1281 microversion: 2.20 time: 0.083000 Sep 01 18:04:09.471267 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 38/66] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:09 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:09.534074 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:09.534841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:09.541925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:09.542487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:09.542928 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:09.543623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:09.544075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:09.544524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:09.681928 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:09.694745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-43971572-0825-4ee1-a692-22860f77aeff tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1218 microversion: 2.1 time: 0.165316 Sep 01 18:04:09.695331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 29/67] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:09 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:09.878145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:09.879284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:09.887661 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:09.888160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:09.888638 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:09.889347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:09.889809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:09.890359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:09.953255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:09.962343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-93c40552-9604-4038-a365-011dcbb9e58b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1284 microversion: 2.1 time: 0.088165 Sep 01 18:04:09.965814 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 39/68] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:09 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:10.493505 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:10.494555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:10.500960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:10.501688 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:10.502299 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:10.503183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:10.504911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:10.505788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:10.577494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:10.588371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:10.590497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:10.594409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dbce45f0-684e-431a-94a7-0f5bd59d0814 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1285 microversion: 2.20 time: 0.103695 Sep 01 18:04:10.595403 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 30/69] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:10 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:10.718214 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:10.718835 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:10.727197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:10.727743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:10.728123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:10.728851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:10.729314 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:10.729758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:10.806012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:10.813819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a1ed6a04-5b70-4c9d-b9bb-4da57d71a2d1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1218 microversion: 2.1 time: 0.101262 Sep 01 18:04:10.814424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 40/70] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:10 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:10.984210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:10.984843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:10.990833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:10.991362 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:10.991801 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:10.992520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:10.992980 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:10.995471 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:11.169946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:11.179198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fdd9ab13-6e06-4589-9bb1-ab466c438937 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1284 microversion: 2.1 time: 0.198763 Sep 01 18:04:11.181374 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 31/71] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:10 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:11.617957 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:11.619082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:11.624502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:11.625001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:11.625428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:11.626115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:11.626555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:11.626975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:11.821860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:11.830541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:11.832633 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:11.833750 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-15cdaff4-622a-4f21-a669-95ca677f0b9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1285 microversion: 2.20 time: 0.219864 Sep 01 18:04:11.834308 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 41/72] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:11 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:11.835300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:11.836002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:11.842578 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:11.843288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:11.843803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:11.844599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:11.845063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:11.845502 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:11.908191 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:11.915773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f644b2e3-ea8a-4bd2-bf3d-2eb50d3bd3c9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1218 microversion: 2.1 time: 0.085774 Sep 01 18:04:11.916349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 32/73] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:11 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:12.203716 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:12.204341 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:12.210466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:12.210948 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:12.211386 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:12.212074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:12.212550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:12.212975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:12.279326 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:12.288624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-780cc897-8ae5-4bc3-a742-41be7d71163d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1284 microversion: 2.1 time: 0.088757 Sep 01 18:04:12.291056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 42/74] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:12 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:12.855531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:12.859450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:12.862870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:12.863832 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:12.864641 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:12.865624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:12.866225 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:12.866764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:12.936518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:12.937141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:12.943255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:12.943744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:12.944184 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:12.944912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:12.945368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:12.946234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:13.016416 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:13.040789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d68bb0fa-04f3-488d-8df8-20378da26495 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1274 microversion: 2.1 time: 0.095886 Sep 01 18:04:13.041997 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 43/75] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:12 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:13.052477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:13.064831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:13.068720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:13.071173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-35773907-bab5-471c-ac11-6c9ce9899a84 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1285 microversion: 2.20 time: 0.219433 Sep 01 18:04:13.072786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 33/76] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:12 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:13.309392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:13.310238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:13.317211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:13.317732 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:13.318166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:13.318938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:13.319423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:13.320044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:13.385200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:13.396485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a41b498f-9a2e-4c96-807a-8901240062ae tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1272 microversion: 2.1 time: 0.091071 Sep 01 18:04:13.410813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 44/77] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:13 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:14.061132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:14.061803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:14.070113 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:14.083085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:14.083085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:14.083085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:14.083085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:14.105806 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:14.106065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:14.106065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:14.109679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:14.110174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:14.110611 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:14.111313 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:14.111769 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:14.112207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:14.211848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:14.231268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:14.259219 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:14.260865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:14.267393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d390fd62-f831-4a8c-a327-158184da4383 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1333 microversion: 2.20 time: 0.170664 Sep 01 18:04:14.267393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 45/78] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:14 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1333 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:14.269468 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ea94907f-8f2d-462e-8f5d-b1a0a4b98f7b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1282 microversion: 2.1 time: 0.220348 Sep 01 18:04:14.291125 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 34/79] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:14 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1282 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:14.421549 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:14.422630 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:14.430905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:14.431501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:14.431868 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:14.432605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:14.433058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:14.433482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:14.967537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:14.978711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7bf65837-3ae2-4201-81e1-5ec42708a41d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.563238 Sep 01 18:04:14.979873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 46/80] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:14 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:15.294119 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:15.296056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:15.307856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:15.308618 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:15.309254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:15.310210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:15.310817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:15.311827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:15.323463 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:15.324862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:15.345993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:15.346786 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:15.347547 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:15.348585 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:15.349572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:15.350185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:15.607385 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:15.619097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e5026fc6-3cfd-409a-b49b-2f98710b0bd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1280 microversion: 2.1 time: 0.299773 Sep 01 18:04:15.625604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 47/81] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:15 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:16.001794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:16.002623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:16.026038 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:16.034212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:16.034212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:16.034212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:16.034212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:16.034812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:16.104628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:16.127911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:16.140623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:16.142405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e6739396-bd84-4071-b110-342e6aaccf4d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1341 microversion: 2.20 time: 0.853366 Sep 01 18:04:16.143192 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 35/82] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:15 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1341 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:16.482345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:16.514989 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:16.679238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1fd0a704-61a3-48c3-a434-4b2dab202d09 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.535967 Sep 01 18:04:16.679238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 48/83] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:15 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:16.680004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:16.680004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:16.680004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:16.680004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:16.680887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:16.680887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:16.680887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:16.680887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:17.173649 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:17.174485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:17.184349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:17.188515 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:17.194124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:17.194124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:17.194124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:17.194124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:17.401235 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:17.426625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d0f90018-4628-4bd0-8e21-c24ee313d175 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.777547 Sep 01 18:04:17.428037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 36/84] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:16 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:17.440824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:17.457050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:17.460149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:17.466603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0de30293-63ec-4143-8396-4e5d4e1ecb4b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1339 microversion: 2.20 time: 0.296731 Sep 01 18:04:17.469315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 49/85] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:17 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:17.702917 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:17.703510 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:17.713636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:17.718348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:17.718348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:17.718348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:17.718348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:17.718711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:17.865236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=4 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:17.911537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=18 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:18.132294 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:18.145736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-aa21b6d3-adb7-4c1f-89d4-e1ce877b1d75 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.446602 Sep 01 18:04:18.151766 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 37/86] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:17 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:18.478009 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:18.479759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:18.515246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:18.516120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:18.532025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:18.532678 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:18.536519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:18.542771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:18.542771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:18.542771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:18.545746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:18.553681 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:18.554564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:18.558410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:18.749666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:18.749666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:18.861571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:18.879014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-71984f5d-eaf8-4e3f-bc4a-8dbc8ae68bcc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.404946 Sep 01 18:04:18.880457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 50/87] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:18 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:18.903345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:18.930219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:18.948135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:18.948135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ebd99c72-5a83-476e-9df9-533bb2e668c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1339 microversion: 2.20 time: 0.437537 Sep 01 18:04:18.948135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 38/88] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:18 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1339 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:19.028548 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-e43a9294-2a49-4cbd-9da7-abbcd8fe4295 req-6330fcb7-6185-457d-81b3-eeeaab789271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4f11d5-97c7-4f32-86bd-71967d45e5ed", "tag": "ed8a669c-c810-4434-b401-01f61d9036c1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:19.051008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e43a9294-2a49-4cbd-9da7-abbcd8fe4295 req-6330fcb7-6185-457d-81b3-eeeaab789271 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:19.051811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e43a9294-2a49-4cbd-9da7-abbcd8fe4295 req-6330fcb7-6185-457d-81b3-eeeaab789271 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:19.052509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e43a9294-2a49-4cbd-9da7-abbcd8fe4295 req-6330fcb7-6185-457d-81b3-eeeaab789271 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:19.075273 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-e43a9294-2a49-4cbd-9da7-abbcd8fe4295 req-6330fcb7-6185-457d-81b3-eeeaab789271 service nova] Creating event network-changed:ed8a669c-c810-4434-b401-01f61d9036c1 for instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed on hv-cinder-74915 Sep 01 18:04:19.075825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e43a9294-2a49-4cbd-9da7-abbcd8fe4295 req-6330fcb7-6185-457d-81b3-eeeaab789271 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 18:04:19.076233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e43a9294-2a49-4cbd-9da7-abbcd8fe4295 req-6330fcb7-6185-457d-81b3-eeeaab789271 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 18:04:19.077428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:19.077975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:19.078457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:19.079173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:19.079624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:19.080043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:19.090912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.compute.rpcapi [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 18:04:19.092334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] Releasing lock "compute-rpcapi-router" {{(pid=121221) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 18:04:19.110629 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c5e381d9-ac8b-444b-b449-6411ea020044 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228652 Sep 01 18:04:19.111832 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 51/89] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:19.179170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:19.182322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:19.191419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:19.192498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:19.195203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:19.196239 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:19.198339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:19.198947 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:19.751903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:19.761131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f906b9df-0cfc-4b04-ade8-d7f80b8c449e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.586863 Sep 01 18:04:19.761738 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 39/90] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:19 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:19.905606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:19.906653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:19.909068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=24 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:20.006904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:20.006904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:20.006904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:20.006904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:20.007969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:20.007969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:20.009565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:20.009565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:20.009565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:20.009565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:20.010121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:20.010121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:20.010121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:20.010121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:20.151851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:20.162844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4a6e3bc2-eaa8-4ae8-9ccc-98338ac6811a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.261601 Sep 01 18:04:20.176754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 52/91] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:19 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:20.267810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:20.278145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:20.296557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:20.296557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-014fd1e4-1472-4d90-8f8e-b1eb475f31f5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.312212 Sep 01 18:04:20.298842 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 40/92] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:19 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:20.421999 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-1c63e1b8-155e-4645-b8bd-4763ad85dcf9 req-b17350f4-1045-4bd5-ac7f-9d2e98467920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5937468-debf-4941-8ccb-0809386abf2d", "tag": "7058a1c8-0e4d-4bb2-b86e-133b7c35bf09"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:20.438320 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-1c63e1b8-155e-4645-b8bd-4763ad85dcf9 req-b17350f4-1045-4bd5-ac7f-9d2e98467920 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:20.438796 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-1c63e1b8-155e-4645-b8bd-4763ad85dcf9 req-b17350f4-1045-4bd5-ac7f-9d2e98467920 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:20.439229 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-1c63e1b8-155e-4645-b8bd-4763ad85dcf9 req-b17350f4-1045-4bd5-ac7f-9d2e98467920 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:20.443359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:20.461333 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-1c63e1b8-155e-4645-b8bd-4763ad85dcf9 req-b17350f4-1045-4bd5-ac7f-9d2e98467920 service nova] Creating event network-changed:7058a1c8-0e4d-4bb2-b86e-133b7c35bf09 for instance b5937468-debf-4941-8ccb-0809386abf2d on hv-cinder-74915 Sep 01 18:04:20.470717 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-1c63e1b8-155e-4645-b8bd-4763ad85dcf9 req-b17350f4-1045-4bd5-ac7f-9d2e98467920 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300860 Sep 01 18:04:20.473925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 53/93] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:20.793268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:20.793268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:20.793268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:20.793268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:20.795140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:20.795876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:20.796351 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:20.796805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:20.974218 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:20.982238 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2d88c1c6-45ee-4b0c-b827-58ba17bc4d2e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.202035 Sep 01 18:04:20.987404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 41/94] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:20 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:21.126269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-c6659522-dba8-4cd0-b6ce-0533e3122e58 req-a9d2b314-c924-4cd2-b5ac-d2be1e260517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cf4db5-1407-4e35-a751-313dc207527d", "tag": "dc3bf96d-bcdb-477d-bc5a-61185c9768fb"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:21.137360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c6659522-dba8-4cd0-b6ce-0533e3122e58 req-a9d2b314-c924-4cd2-b5ac-d2be1e260517 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:21.137988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c6659522-dba8-4cd0-b6ce-0533e3122e58 req-a9d2b314-c924-4cd2-b5ac-d2be1e260517 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:21.138510 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-c6659522-dba8-4cd0-b6ce-0533e3122e58 req-a9d2b314-c924-4cd2-b5ac-d2be1e260517 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:21.150502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-c6659522-dba8-4cd0-b6ce-0533e3122e58 req-a9d2b314-c924-4cd2-b5ac-d2be1e260517 service nova] Creating event network-changed:dc3bf96d-bcdb-477d-bc5a-61185c9768fb for instance 83cf4db5-1407-4e35-a751-313dc207527d on hv-cinder-74915 Sep 01 18:04:21.155687 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-c6659522-dba8-4cd0-b6ce-0533e3122e58 req-a9d2b314-c924-4cd2-b5ac-d2be1e260517 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033467 Sep 01 18:04:21.156828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 54/95] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:21.191194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:21.192373 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:21.200941 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:21.201410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:21.201841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:21.202524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:21.203082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:21.203380 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:21.310114 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:21.311121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:21.320275 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:21.321043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:21.322271 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:21.323384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:21.323837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:21.324260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:21.383162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:21.408134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-43d815d0-96f1-486b-8622-2ac453ee6d05 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.220868 Sep 01 18:04:21.431064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 42/96] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:21 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:21.600629 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:21.600629 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:21.601074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:21.601074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4be054eb-a9eb-458e-98cf-d00845a39935 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.256574 Sep 01 18:04:21.601074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 55/97] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:21 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:22.005130 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:22.006452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:22.014084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:22.014897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:22.015601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:22.016628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:22.017438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:22.018007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:22.223912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:22.231817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-91b6305d-79be-4f10-841c-c8a9c9019e74 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.232063 Sep 01 18:04:22.232409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 43/98] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:21 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:22.467207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:22.468150 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:22.476843 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:22.478374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:22.482122 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:22.483880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:22.485189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:22.485797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:22.631685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:22.633515 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:22.640602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:22.641154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:22.641595 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:22.642428 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:22.643111 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:22.643538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:22.883643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:22.883643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c7bb1ee3-5713-4731-bf1a-176506c7211b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.224098 Sep 01 18:04:22.883643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 56/99] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:22 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:22.884877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:22.884877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:22.884877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:22.886138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:22.886138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fd9150cc-abbc-477b-b88c-eb32a6ce1210 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.195704 Sep 01 18:04:22.886138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 44/100] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:22 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:23.253454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:23.253954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:23.259979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:23.260492 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:23.260925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:23.261616 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:23.262060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:23.262480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:23.425680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:23.434998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f5e36d90-6744-411f-9d1b-2f9879763741 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.185011 Sep 01 18:04:23.451247 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 57/101] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:23 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:23.837944 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:23.838639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:23.842355 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:23.844675 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:23.845333 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:23.850188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:23.852603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:23.852925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:23.853601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:23.854088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:23.855037 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:23.855199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:23.856116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:23.856963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:23.857397 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:23.866020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:23.866724 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:24.060216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:24.062332 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:24.072217 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:24.076495 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a1e9f4cb-2810-4935-8fc8-c6c92bc92fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.242799 Sep 01 18:04:24.076589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:24.076589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dd9fcaac-0645-485c-8e33-610bc2820bd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.241521 Sep 01 18:04:24.076589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 58/102] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:23 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:24.082262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 45/103] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:23 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:24.455413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:24.459400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:24.463186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:24.463660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:24.464114 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:24.464825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:24.465270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:24.465828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:24.598231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:24.609873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-22f16003-09e4-4f9c-bbe2-04e792289e6f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.156529 Sep 01 18:04:24.609873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 59/104] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:24 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:25.097207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:25.097908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:25.100838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:25.101993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:25.104088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:25.104618 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:25.105046 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:25.105916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:25.106365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:25.106784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:25.109422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:25.115149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:25.115149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:25.115149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:25.115149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:25.115506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:25.240459 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:25.249302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a1587483-660d-4539-83cf-4c6d51508918 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.155809 Sep 01 18:04:25.262283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 46/105] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:25 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:25.289268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:25.300782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:25.302924 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:25.304298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4c165544-e1bb-4471-9d06-951c35a599a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.207584 Sep 01 18:04:25.305096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 60/106] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:25 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:25.629652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:25.630273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:25.636724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:25.637201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:25.637812 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:25.638715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:25.639300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:25.639876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:25.777919 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:25.786423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bfcf3305-cac8-4248-8beb-7f924ad85af3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.161115 Sep 01 18:04:25.786994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 47/107] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:25 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:26.279701 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:26.279701 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:26.282204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:26.282919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:26.283483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:26.285279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:26.286156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:26.287269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:26.327029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:26.327739 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:26.336820 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:26.337632 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:26.338132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:26.338839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:26.341792 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:26.344994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:26.505472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:26.510476 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:26.512178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:26.513552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e1fe08a8-9997-4d6c-a5b7-7e9f3e023822 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.190468 Sep 01 18:04:26.514968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 48/108] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:26 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:26.516186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:26.528371 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ca9934c7-5390-48d6-9f1d-f1098c5dfd72 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.258405 Sep 01 18:04:26.542146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 61/109] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:26 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:26.806787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:26.807412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:26.809306 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:26.814722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:26.819350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:26.819350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:26.819350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:26.819350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:26.819743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:26.957664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:26.965620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fe14516d-de1e-47d9-a5a7-b2e4695c31ce tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.162842 Sep 01 18:04:26.966199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 49/110] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:26 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:27.538721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:27.539339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:27.547738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:27.548234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:27.548699 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:27.549403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:27.549856 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:27.549968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:27.551139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:27.551672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:27.559655 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:27.564421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:27.564934 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:27.565699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:27.566229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:27.566664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:27.870480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:27.882840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:27.887673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:27.890100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0d3d0752-8acd-44f7-932a-24b53f96e87b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.355795 Sep 01 18:04:27.913669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 62/111] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:27 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:27.986838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:27.987437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:28.013826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:28.015738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:28.016188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:28.017093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:28.017781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:28.018201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:28.176698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:28.185148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e22067e8-98e8-423b-8d9b-6bf8588a7791 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.638775 Sep 01 18:04:28.207732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 50/112] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:27 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:28.280705 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:28.292883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8b225a03-3284-4c5f-9d02-e63f7f1eff63 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.310812 Sep 01 18:04:28.294033 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 63/113] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:27 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:28.920011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:28.921168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:28.927966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:28.928543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:28.928977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:28.929667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:28.930115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:28.930538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.104206 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:29.114230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:29.115684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:29.116831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-86672afa-5126-45fd-a87b-c2b31bc5830b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.201149 Sep 01 18:04:29.117390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 51/114] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:28 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:29.230608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-574b48b6-3776-405d-83fa-00a1d9c145ca req-77ba601f-9b65-4323-a34d-35b8f96f446b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47", "tag": "2f84538c-e0cf-462c-ba99-07996763dee1"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:29.236781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:29.237490 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:29.248682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:29.253887 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:29.253887 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:29.253887 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.256230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:29.257440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:29.258346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.259748 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-574b48b6-3776-405d-83fa-00a1d9c145ca req-77ba601f-9b65-4323-a34d-35b8f96f446b service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:29.260101 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-574b48b6-3776-405d-83fa-00a1d9c145ca req-77ba601f-9b65-4323-a34d-35b8f96f446b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:29.261367 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-574b48b6-3776-405d-83fa-00a1d9c145ca req-77ba601f-9b65-4323-a34d-35b8f96f446b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.288208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-574b48b6-3776-405d-83fa-00a1d9c145ca req-77ba601f-9b65-4323-a34d-35b8f96f446b service nova] Creating event network-changed:2f84538c-e0cf-462c-ba99-07996763dee1 for instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 on hv-cinder-74915 Sep 01 18:04:29.288208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-574b48b6-3776-405d-83fa-00a1d9c145ca req-77ba601f-9b65-4323-a34d-35b8f96f446b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 18:04:29.288208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-574b48b6-3776-405d-83fa-00a1d9c145ca req-77ba601f-9b65-4323-a34d-35b8f96f446b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 18:04:29.288208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:29.288208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:29.288682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.288682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:29.288682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:29.288682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.298695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.compute.rpcapi [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 18:04:29.299638 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] Releasing lock "compute-rpcapi-router" {{(pid=121220) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 18:04:29.333633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4b684441-b63b-473b-a391-fb5fb5d187e7 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106907 Sep 01 18:04:29.334239 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 52/115] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:29.364285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:29.365026 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:29.380613 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:29.383328 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:29.383781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.386601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:29.387066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:29.387499 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:29.478377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:29.488774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-685cc70d-9f30-4593-9e81-a3f37acc28a9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.263103 Sep 01 18:04:29.490790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 64/116] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:29 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:29.563635 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:29.571383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bb97c23f-a0f6-493b-9f6b-bac8b0d5782e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.236013 Sep 01 18:04:29.571960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 53/117] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:29 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:30.148612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:30.148612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:30.148612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:30.148612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:30.149461 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:30.149611 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:30.150071 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:30.150498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:30.294865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:30.303437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:30.304909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:30.306016 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8993b31c-c457-4bf9-ac9f-f287146d5b13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.170391 Sep 01 18:04:30.306568 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 65/118] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:30 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:30.511035 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:30.511866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:30.518085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:30.518740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:30.519867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:30.520734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:30.521389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:30.522129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:30.598080 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:30.599105 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:30.605859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:30.606468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:30.606981 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:30.607791 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:30.608477 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:30.609073 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:30.657483 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:30.669189 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8193add8-1e0b-4ccf-a646-050c60e2a9f7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.162344 Sep 01 18:04:30.669980 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 54/119] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:30 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:30.773136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:30.780967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4bf22e5e-4ab8-4275-9a75-273c63e04cec tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.190652 Sep 01 18:04:30.781783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 66/120] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:30 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:31.329440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:31.330110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:31.340898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:31.342669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:31.344579 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:31.345596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:31.346091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:31.346522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:31.633604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:31.642406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:31.643822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:31.644979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9c943b01-b5e9-4f8b-b2ef-650ea9988a87 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.320070 Sep 01 18:04:31.645571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 55/121] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:31 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:31.691819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:31.695591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:31.702332 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:31.702816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:31.703245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:31.703936 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:31.704607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:31.705241 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:31.802858 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:31.803388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:31.813145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:31.813647 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:31.814090 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:31.814806 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:31.815264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:31.816274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:31.902887 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:31.912074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d7b50219-428e-45de-a8cf-6f929ccd2a0a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.225116 Sep 01 18:04:31.916742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 67/122] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:31 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:31.977921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:31.985558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-97284be8-eef2-4f03-9a9b-2cba642ffbd2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.187603 Sep 01 18:04:31.986104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 56/123] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:31 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:32.667961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:32.668648 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:32.674531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:32.675105 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:32.675733 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:32.676473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:32.676922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:32.677339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:32.804558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:32.812684 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:32.814120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:32.815208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-85042870-b8ee-4c65-aa58-379a529c94c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.151142 Sep 01 18:04:32.816299 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 68/124] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:32 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:32.933554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:32.934205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:32.940070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:32.941201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:32.941778 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:32.945346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:32.945346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:32.945346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:33.009010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:33.009716 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:33.015651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:33.016195 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:33.016660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:33.017346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:33.019859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:33.019859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:33.073640 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:33.081868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-eabb52f1-91a6-4ffd-b6db-d6a38f640a99 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.151611 Sep 01 18:04:33.082656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 57/125] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:32 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:33.153338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:33.162181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9d445173-0ded-4f6b-a2f2-eb7ca79a8bd0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.157030 Sep 01 18:04:33.162745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 69/126] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:33 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:33.839417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:33.840292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:33.847528 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:33.848406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:33.848912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:33.849871 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:33.850388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:33.851141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:34.105504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:34.108481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:34.122077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:34.122077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:34.122077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:34.122077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:34.122858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:34.126215 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:34.139283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:34.148134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:34.149608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:34.150726 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ea198547-ee88-489b-9c97-6303fdfdde3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.315604 Sep 01 18:04:34.157679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 58/127] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:33 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:34.183050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:34.183669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:34.190315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:34.191718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:34.192292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:34.199711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:34.199711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:34.199711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:34.293586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:34.308118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-34578dee-d163-41c9-b3bc-2f5fddcaf35d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.207287 Sep 01 18:04:34.309422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 70/128] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:34 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:34.400153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:34.408114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-83ab25b7-7b7a-449c-870c-35666c18b251 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.229435 Sep 01 18:04:34.408730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 59/129] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:34 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:35.179439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:35.180073 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:35.186207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:35.186560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:35.187015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:35.187952 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:35.188422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:35.188834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:35.194384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:35.327128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:35.327740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:35.335910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:35.336429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:35.337183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:35.338087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:35.338682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:35.339297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:35.359609 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:35.367001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:35.368600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:35.369839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4da5ce63-c0f3-4557-828d-ea48e049b53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.194932 Sep 01 18:04:35.370504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 71/130] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:35 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:35.429675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:35.430400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:35.437350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:35.437838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:35.438324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:35.439086 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:35.439793 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:35.441162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:35.477097 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:35.486285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-62c16348-cc98-4498-b8a8-3d97058c6cd5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.163110 Sep 01 18:04:35.487049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 60/131] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:35 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:35.587353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:35.596188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ef12d338-cbf8-40b9-9f88-181056c51c24 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.170261 Sep 01 18:04:35.597425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 72/132] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:35 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:35.671437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-48587504-01f2-468a-b53f-1941a9e5ee92 req-2653f91e-4845-4011-a6cb-16b34a2611aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5937468-debf-4941-8ccb-0809386abf2d", "name": "network-vif-plugged", "status": "completed", "tag": "7058a1c8-0e4d-4bb2-b86e-133b7c35bf09"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:35.682793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-48587504-01f2-468a-b53f-1941a9e5ee92 req-2653f91e-4845-4011-a6cb-16b34a2611aa service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:35.688470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-48587504-01f2-468a-b53f-1941a9e5ee92 req-2653f91e-4845-4011-a6cb-16b34a2611aa service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:35.688470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-48587504-01f2-468a-b53f-1941a9e5ee92 req-2653f91e-4845-4011-a6cb-16b34a2611aa service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:35.695469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-48587504-01f2-468a-b53f-1941a9e5ee92 req-2653f91e-4845-4011-a6cb-16b34a2611aa service nova] Creating event network-vif-plugged:7058a1c8-0e4d-4bb2-b86e-133b7c35bf09 for instance b5937468-debf-4941-8ccb-0809386abf2d on hv-cinder-74915 Sep 01 18:04:35.700558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-48587504-01f2-468a-b53f-1941a9e5ee92 req-2653f91e-4845-4011-a6cb-16b34a2611aa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211627 Sep 01 18:04:35.701288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 61/133] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:36.393032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:36.394695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:36.401976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:36.406738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:36.406738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:36.406738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:36.406738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:36.407074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:36.512060 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:36.512918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:36.536248 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:36.542591 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:36.543392 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:36.545066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:36.545756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:36.546425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:36.575158 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:36.787744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:36.799580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:36.802340 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:36.803723 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-71efe5bf-0e53-4820-8782-0a80d10fae0a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.414798 Sep 01 18:04:36.804777 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 73/134] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:36 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:36.811309 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:36.812048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:36.818984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:36.819709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:36.820426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:36.821537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:36.822143 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:36.822860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:37.042519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:37.052429 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-781d5ea1-d66c-4bef-a664-c0fd3e0d5fe2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.245906 Sep 01 18:04:37.054079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 74/135] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:36 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:37.162776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:37.171414 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c3f4833c-3ac8-406a-90a4-1790fa4f062b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.663694 Sep 01 18:04:37.172404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 62/136] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:36 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:37.833399 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:37.834622 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:37.842149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:37.842969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:37.844410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:37.845414 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:37.846082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:37.847334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:38.001597 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:38.010500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:38.012667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:38.013795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-06100cc6-d4db-435c-8e61-f64626addc6a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.186280 Sep 01 18:04:38.014348 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 75/137] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:37 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:38.077146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:38.077811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:38.087048 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:38.087527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:38.087954 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:38.088840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:38.089440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:38.089861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:38.193896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:38.194676 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:38.201061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:38.201690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:38.203024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:38.203982 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:38.204567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:38.205113 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:38.377344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:38.395188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8faf4c35-586f-4342-87fd-c7b6532f216c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.206737 Sep 01 18:04:38.405923 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 76/138] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:38 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:38.426672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:38.446709 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-475023d0-e7eb-4a34-8c92-93c2a16c93fc tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.368507 Sep 01 18:04:38.446709 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 63/139] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:38 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:39.040458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:39.040458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:39.044947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:39.045438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:39.046068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:39.046774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:39.047227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:39.047652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:39.094003 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-42847ad9-5753-4444-b2a4-fcba54ab2574 req-4b3e5e58-cbad-464f-bd93-7074c592718c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cf4db5-1407-4e35-a751-313dc207527d", "name": "network-vif-plugged", "status": "completed", "tag": "dc3bf96d-bcdb-477d-bc5a-61185c9768fb"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:39.104637 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-42847ad9-5753-4444-b2a4-fcba54ab2574 req-4b3e5e58-cbad-464f-bd93-7074c592718c service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:39.105169 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-42847ad9-5753-4444-b2a4-fcba54ab2574 req-4b3e5e58-cbad-464f-bd93-7074c592718c service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:39.105663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-42847ad9-5753-4444-b2a4-fcba54ab2574 req-4b3e5e58-cbad-464f-bd93-7074c592718c service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:39.118970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-42847ad9-5753-4444-b2a4-fcba54ab2574 req-4b3e5e58-cbad-464f-bd93-7074c592718c service nova] Creating event network-vif-plugged:dc3bf96d-bcdb-477d-bc5a-61185c9768fb for instance 83cf4db5-1407-4e35-a751-313dc207527d on hv-cinder-74915 Sep 01 18:04:39.130052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-42847ad9-5753-4444-b2a4-fcba54ab2574 req-4b3e5e58-cbad-464f-bd93-7074c592718c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039501 Sep 01 18:04:39.130667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 64/140] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:39.198981 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:39.205367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:39.217613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:39.219405 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f586aab1-6eef-4832-8bd9-d656c6d58018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.186262 Sep 01 18:04:39.220136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 77/141] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:39 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:39.419284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:39.423674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:39.423674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:39.432047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:39.433014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:39.433619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:39.435404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:39.436024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:39.436836 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:39.465775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:39.466639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:39.479034 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:39.479904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:39.480660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:39.481376 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:39.481832 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:39.482257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:39.683873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:39.693878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0f9dafd9-84f5-4112-a131-2492f564fa8b tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.232513 Sep 01 18:04:39.694808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 78/142] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:39 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:39.752277 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:39.764339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b4f657d4-aa7e-4bb9-8040-76c2bbc48233 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.351880 Sep 01 18:04:39.776607 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 65/143] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:39 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:40.244225 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:40.252303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:40.252303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:40.252598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:40.253351 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:40.254423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:40.254928 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:40.255395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:40.422424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:40.430416 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:40.431850 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:40.432973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a79c4e10-95c7-44c7-934b-8d5531e7658f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.195153 Sep 01 18:04:40.434114 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 79/144] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:40 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:40.714691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:40.716335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:40.728551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:40.728886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:40.729327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:40.732033 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:40.732547 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:40.733555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:40.788360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:40.789329 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:40.797407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:40.798162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:40.798773 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:40.799698 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:40.800930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:40.801510 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:40.969615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:40.981759 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-501a7330-6bf9-4665-ba79-d38e42b3e47f tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.271561 Sep 01 18:04:40.986266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 66/145] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:40 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:41.079848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:41.096231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8bb5600c-4373-4d84-aab8-8b30a42b5e02 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.314398 Sep 01 18:04:41.110281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 80/146] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:40 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:41.286212 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-71066360-87b0-4338-92b2-f3feca3240e9 req-9a07c95c-5d89-4f50-89d1-ba8c8c42ed0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4f11d5-97c7-4f32-86bd-71967d45e5ed", "name": "network-vif-plugged", "status": "completed", "tag": "ed8a669c-c810-4434-b401-01f61d9036c1"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:41.297645 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-71066360-87b0-4338-92b2-f3feca3240e9 req-9a07c95c-5d89-4f50-89d1-ba8c8c42ed0e service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:41.298310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-71066360-87b0-4338-92b2-f3feca3240e9 req-9a07c95c-5d89-4f50-89d1-ba8c8c42ed0e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:41.298852 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-71066360-87b0-4338-92b2-f3feca3240e9 req-9a07c95c-5d89-4f50-89d1-ba8c8c42ed0e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:41.317735 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-71066360-87b0-4338-92b2-f3feca3240e9 req-9a07c95c-5d89-4f50-89d1-ba8c8c42ed0e service nova] Creating event network-vif-plugged:ed8a669c-c810-4434-b401-01f61d9036c1 for instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed on hv-cinder-74915 Sep 01 18:04:41.324338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-71066360-87b0-4338-92b2-f3feca3240e9 req-9a07c95c-5d89-4f50-89d1-ba8c8c42ed0e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042103 Sep 01 18:04:41.324338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 67/147] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:41.458053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:41.458787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:41.474610 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:41.475999 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:41.477119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:41.480741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:41.481236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:41.481858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:41.649330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:41.657552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:41.659050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:41.661094 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-32238297-0ef1-4baa-a692-950e0bfa7161 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.207453 Sep 01 18:04:41.661632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 81/148] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:41 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:42.007774 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:42.008494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:42.014554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:42.015036 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:42.015472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:42.016152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:42.016840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:42.017265 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:42.123528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:42.125306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:42.133003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:42.133704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:42.134285 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:42.135125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:42.135717 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:42.136499 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:42.194006 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:42.202920 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-573056ad-0d51-46bd-a414-c960c5ce78f0 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.200243 Sep 01 18:04:42.204134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 68/149] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:42 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:42.318715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:42.337683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-650f81d2-72fc-4982-bef0-efddb24b4bfa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1322 microversion: 2.1 time: 0.221145 Sep 01 18:04:42.337858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 82/150] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:42 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:42.684256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:42.685162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:42.695304 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:42.695788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:42.696216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:42.700612 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:42.701788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:42.702372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:42.965029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:42.999860 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:43.007109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:43.010034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ce2e1a33-cfd1-4543-92ec-6f1be5717b46 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.329772 Sep 01 18:04:43.013323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 69/151] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:42 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:43.229534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:43.230153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:43.236718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:43.237268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:43.238478 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:43.239316 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:43.240144 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:43.240893 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:43.364259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:43.365206 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:43.371781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:43.372271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:43.372761 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:43.373455 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:43.374106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:43.374531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:43.453636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:43.466902 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-51a6e81b-20cf-4f56-9939-ad1fef7011ac tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1314 microversion: 2.1 time: 0.241279 Sep 01 18:04:43.467789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 83/152] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:43 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:43.563981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:43.563981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a974d325-abf3-4c9a-b672-461f11e94173 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1517 microversion: 2.1 time: 0.204653 Sep 01 18:04:43.564284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 70/153] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:43 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:43.585110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:43.587372 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:43.595554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:43.600521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:43.600521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:43.600521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:43.600521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:43.600870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:43.663357 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lazy-loading 'flavor' on Instance uuid b5937468-debf-4941-8ccb-0809386abf2d {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:04:44.040300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:44.041808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:44.053395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:44.054200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:44.057972 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:44.057972 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:44.057972 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:44.057972 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:44.103276 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-538d6795-0bfb-4730-92e2-99af2ce47079 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d/action" status: 200 len: 32 microversion: 2.1 time: 0.522149 Sep 01 18:04:44.104094 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 84/154] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:04:43 2022] POST /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d/action => generated 32 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:04:44.114103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:44.114803 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:44.130450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:44.135740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:44.135740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:44.135740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:44.135740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:44.136163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:44.220713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:44.232449 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:44.234135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:44.236193 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-01a6bc0f-1ec4-4121-9a1b-ddd36455df17 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.199973 Sep 01 18:04:44.237364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 71/155] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:44 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:44.312524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:44.316229 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:44.321008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0bd14133-e595-4df2-9ca3-50e73ae126c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.211289 Sep 01 18:04:44.321577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 85/156] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:44 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:44.489365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:44.490307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:44.496932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:44.497418 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:44.497851 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:44.498576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:44.499027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:44.499450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:44.679162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:44.687620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-36465466-128a-4812-9a8d-95cae63e0bf3 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1501 microversion: 2.1 time: 0.202221 Sep 01 18:04:44.688261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 72/157] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:44 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:45.263230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:45.263390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:45.269535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:45.270018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:45.270446 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:45.271131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:45.271583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:45.271998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:45.343333 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:45.344248 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:45.351053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:45.351540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:45.352271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:45.353161 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:45.354211 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:45.354649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:45.491150 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:45.499801 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:45.501380 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:45.502728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b7945a9a-7d5b-4294-86d7-4eeb01b6402f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.246484 Sep 01 18:04:45.504621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 86/158] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:45 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:45.518544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:45.526908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e19abc84-70d4-44c9-a5d4-3d01760626b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.188357 Sep 01 18:04:45.527476 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 73/159] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:45 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:46.525325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:46.525926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:46.532264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:46.532763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:46.533188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:46.533867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:46.534348 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:46.534883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:46.547762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:46.548373 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:46.555140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:46.555601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:46.556028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:46.556739 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:46.557183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:46.557599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:46.677813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:46.686616 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:46.688057 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:46.689229 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cfd1f662-2f0f-4bfb-acc2-68a5cc87bb9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.168269 Sep 01 18:04:46.689793 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 87/160] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:46 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:46.715836 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:46.724664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-acce3867-6f10-4b3e-abd9-5ada0994a9b5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.179751 Sep 01 18:04:46.726063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 74/161] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:46 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:47.712286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:47.712896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:47.719407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:47.719884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:47.720324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:47.721011 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:47.721454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:47.722465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:47.757492 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:47.758094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:47.763942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:47.764453 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:47.764884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:47.765594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:47.766042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:47.766634 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:47.886204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:47.896827 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:47.898573 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:47.900151 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-71b029c2-6bda-469e-ae6d-a283995dea5c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.191702 Sep 01 18:04:47.900928 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 88/162] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:47 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:47.918852 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:47.927199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5aa7a294-78bf-4855-9d38-03e82798e805 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.174057 Sep 01 18:04:47.928152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 75/163] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:47 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:48.922484 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:48.923079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:48.930344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:48.930803 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:48.931226 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:48.931897 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:48.932357 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:48.941331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:48.950139 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:48.950752 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:48.957077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:48.957721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:48.958167 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:48.958868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:48.959325 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:48.959763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:49.077058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:49.090742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:49.093093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:49.094390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fbe5d034-68e9-4f27-b314-c5d00254aba4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.175731 Sep 01 18:04:49.095295 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 89/164] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:48 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:49.121821 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:49.130340 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-18e459b5-3c38-4763-80c5-505c684c88f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.184084 Sep 01 18:04:49.130900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 76/165] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:48 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:50.118327 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:50.118919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:50.124731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:50.125403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:50.125828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:50.126500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:50.127115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:50.127528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:50.151345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:50.151946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:50.158288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:50.168983 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:50.169779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:50.170868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:50.171339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:50.171936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:50.278070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:50.286961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:50.293994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:50.293994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-57f1c246-824d-48c8-abf0-95054e35947e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.175153 Sep 01 18:04:50.293994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 90/166] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:50 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:50.309092 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:50.318115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-553e010a-b458-4fda-aab8-c36086f6352f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.169958 Sep 01 18:04:50.325429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 77/167] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:50 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:50.663423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-441a74fb-03c1-4947-9a40-03b1a7b50ba2 req-c0e4d2a0-c479-4beb-9676-54961f41bb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47", "name": "network-vif-plugged", "status": "completed", "tag": "2f84538c-e0cf-462c-ba99-07996763dee1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:50.673094 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-441a74fb-03c1-4947-9a40-03b1a7b50ba2 req-c0e4d2a0-c479-4beb-9676-54961f41bb2f service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:50.673592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-441a74fb-03c1-4947-9a40-03b1a7b50ba2 req-c0e4d2a0-c479-4beb-9676-54961f41bb2f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:50.674012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-441a74fb-03c1-4947-9a40-03b1a7b50ba2 req-c0e4d2a0-c479-4beb-9676-54961f41bb2f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:50.685563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-441a74fb-03c1-4947-9a40-03b1a7b50ba2 req-c0e4d2a0-c479-4beb-9676-54961f41bb2f service nova] Creating event network-vif-plugged:2f84538c-e0cf-462c-ba99-07996763dee1 for instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 on hv-cinder-74915 Sep 01 18:04:50.690471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-441a74fb-03c1-4947-9a40-03b1a7b50ba2 req-c0e4d2a0-c479-4beb-9676-54961f41bb2f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031637 Sep 01 18:04:50.691042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 91/168] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:04:51.016691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69533c99-f115-466e-81db-b7c7786a7486"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:04:51.019750 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:51.025938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:51.026419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:51.026853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:51.027547 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:51.027995 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:51.028440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:51.311894 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:51.327619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:51.327619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:51.327619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:51.327619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:51.327955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:51.327955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:51.327955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:51.457658 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:51.466044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:51.467481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:51.468600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b27e6eed-2ca4-457f-8505-4e2e47e3729f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.161020 Sep 01 18:04:51.469154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 92/169] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:51 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:51.473719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:51.474307 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:51.479898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:51.480396 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:51.480828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:51.481505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:51.481950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:51.482367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:51.612592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:51.620231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ac305b43-6c7e-4d11-9a3e-705d619f131a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.150144 Sep 01 18:04:51.620817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 93/170] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:51 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:52.493048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:52.494060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:52.500401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:52.500918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:52.507043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:52.507043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:52.507043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:52.507043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:52.660168 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:52.668918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:52.670385 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:52.671507 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-68e8a956-8280-4faa-a6c5-c10403a538ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.184598 Sep 01 18:04:52.672070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 94/171] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:52 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:04:52.676545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:52.677344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:52.683263 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:52.683743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:52.687662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:52.687662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:52.687662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:52.687662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:52.718203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-483935fd-cdf6-4ab3-8059-2070aa695ec2 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "POST /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.705379 Sep 01 18:04:52.719333 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 78/172] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:04:51 2022] POST /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d/os-volume_attachments => generated 194 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:04:52.826360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:52.835690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ca44144d-fcea-4d67-8ee9-2ae674ca144c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.162614 Sep 01 18:04:52.836255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 95/173] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:52 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:53.695450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:53.696233 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:53.702723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:53.703211 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:53.703648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:53.704371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:53.704827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:53.705252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:53.709701 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:53.839402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:53.848187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:53.849732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:53.852593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0e7291e8-62ce-4b23-a525-a494566fdc09 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.160533 Sep 01 18:04:53.852593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 79/174] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:53 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:53.857855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:53.858341 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:53.864549 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:53.867246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:53.867714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:53.868466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:53.870347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:53.870347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:53.998297 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:54.006381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-13212b4d-9301-4f19-b795-c4736f821666 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.152466 Sep 01 18:04:54.011220 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 96/175] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:53 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:04:54.874697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:54.875243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:54.881900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:54.882376 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:54.882853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:54.883532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:54.883977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:54.884428 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:55.015706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:55.024422 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:55.025857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:55.026754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:55.027191 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2d5f1893-5e21-454f-a8c6-8a4d3b9b8e47 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.156848 Sep 01 18:04:55.027390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:55.027538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 80/176] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:54 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:55.033795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:55.034801 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:55.035339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:55.035904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:55.036369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:55.036778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:55.180358 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:55.188135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0af4f5b9-8593-4cf6-a905-a429ea2c4aa5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.165128 Sep 01 18:04:55.188719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 97/177] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:55 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:56.050498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:56.051295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:56.058382 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:56.060068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:56.060068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:56.060068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:56.060423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:56.060845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:56.195141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:56.203794 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:56.206562 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:56.207744 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8596b33f-09b3-431f-a777-70ab211a8095 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.161687 Sep 01 18:04:56.210877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:56.211806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:56.219031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:56.220463 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:56.220463 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:56.220715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:56.221002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 81/178] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:56 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:56.221333 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:56.222326 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:56.351935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:56.359842 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e4de31bc-8200-4ec4-84f1-0af0f3ce020e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.153755 Sep 01 18:04:56.360417 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 98/179] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:56 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:57.235079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:57.240931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:57.248116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:57.248643 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:57.249106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:57.249800 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:57.250248 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:57.250673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:57.380219 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:57.380905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:57.382912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:57.386743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:57.387215 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:57.387643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:57.388334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:57.388865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:57.389211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:57.391490 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:57.392916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:57.394122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-58c0cb95-f23b-4eb2-abda-9b3f0fa4f6fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.163288 Sep 01 18:04:57.394836 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 82/180] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:57 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:57.519874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:57.528170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-11f4b238-ae97-47f1-93b4-2772094ef843 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.152269 Sep 01 18:04:57.528767 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 99/181] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:57 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:58.418603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:58.419208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:58.426205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:58.426705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:58.427129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:58.427815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:58.428260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:58.428706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:58.550607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:58.551220 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:58.553392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=83 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:04:58.558050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:58.558533 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:58.558968 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:58.559694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:58.560146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:58.560596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:58.561779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:58.570912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:58.572450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:58.573569 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f58bd85a-801b-4144-804e-08756a545b9e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.160587 Sep 01 18:04:58.577678 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 83/182] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:58 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:58.694723 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:58.705025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e58fc01c-fdc0-44b2-be55-a0cd1b53b1c7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.158790 Sep 01 18:04:58.706996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 100/183] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:58 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:04:59.595540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:59.600404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:59.602912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:59.603392 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:59.603819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:59.604537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:59.605140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:59.605564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:59.726916 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:04:59.727596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:04:59.734031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:59.738044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:59.738044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:59.738044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:04:59.738044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:04:59.738423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:04:59.765926 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:59.774259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:59.775688 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:59.776827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fd3bfb41-d338-4294-9284-3ddde9adb91d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1405 microversion: 2.20 time: 0.185244 Sep 01 18:04:59.777382 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 84/184] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:04:59 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:04:59.868479 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:04:59.876819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-864cb141-3366-40c3-a067-3be512dd07a5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.154075 Sep 01 18:04:59.877410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 101/185] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:04:59 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:00.801991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:00.802624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:00.805813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=72 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:00.810454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:00.811029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:00.811873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:00.812776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:00.813392 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:00.813968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:00.901188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:00.903743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:00.916393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:00.917024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:00.917668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:00.918971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:00.920678 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:00.921475 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:00.992726 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:01.002585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:01.004218 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:01.005655 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bea1cfcd-525a-46e8-addd-3668b1e38825 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1598 microversion: 2.20 time: 0.207506 Sep 01 18:05:01.006327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 85/186] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:05:00 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1598 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:05:01.029618 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:01.030190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:01.038328 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:01.038813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:01.039441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:01.039973 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:01.049046 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:01.049046 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:01.115177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:01.122933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d9eb9c7a-16eb-4c5e-9260-194d3b62d6c1 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.227644 Sep 01 18:05:01.123502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 102/187] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:00 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:01.136865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ad551f1f-ecab-431e-8ea3-ea3c6f4be14f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111388 Sep 01 18:05:01.137467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 86/188] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Sep 1 18:05:01 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:05:02.145145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:02.145756 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:02.151879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:02.152304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:02.152771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:02.153465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:02.153921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:02.154347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:02.158600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:02.290231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:02.298157 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ac9a93b1-5ecc-4699-8043-373a8cf57fa2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.157624 Sep 01 18:05:02.298826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 103/189] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:02 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:02.539631 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-6853abf9-a18b-43dc-b366-36e7523345f9 req-bb8ddd10-6487-451a-8682-89059a522198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47", "tag": "2f84538c-e0cf-462c-ba99-07996763dee1"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:05:02.549007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-6853abf9-a18b-43dc-b366-36e7523345f9 req-bb8ddd10-6487-451a-8682-89059a522198 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:02.549643 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-6853abf9-a18b-43dc-b366-36e7523345f9 req-bb8ddd10-6487-451a-8682-89059a522198 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:02.550247 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-6853abf9-a18b-43dc-b366-36e7523345f9 req-bb8ddd10-6487-451a-8682-89059a522198 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:02.562876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-6853abf9-a18b-43dc-b366-36e7523345f9 req-bb8ddd10-6487-451a-8682-89059a522198 service nova] Creating event network-changed:2f84538c-e0cf-462c-ba99-07996763dee1 for instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 on hv-cinder-74915 Sep 01 18:05:02.571990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-6853abf9-a18b-43dc-b366-36e7523345f9 req-bb8ddd10-6487-451a-8682-89059a522198 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037431 Sep 01 18:05:02.572895 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 87/190] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:05:03.319913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:03.320551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:03.326871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:03.327353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:03.327780 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:03.328597 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:03.329048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:03.329550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:03.459472 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:03.467596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e579610f-88ea-4352-9bae-8922bb8ce67c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.152449 Sep 01 18:05:03.468352 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 104/191] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:03 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:04.488989 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:04.489678 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:04.495694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:04.496278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:04.496744 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:04.497422 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:04.497867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:04.498283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:04.631063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:04.643284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f0de82e8-1b0c-468e-bb3d-f888471a1bb3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.158956 Sep 01 18:05:04.644866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 88/192] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:04 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:05.668181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:05.668865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:05.675541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:05.676200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:05.676660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:05.677364 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:05.677815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:05.678236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:05.810612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:05.817448 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cd7bb5b3-495b-46a7-a1f3-d1ebb82c5011 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.153129 Sep 01 18:05:05.818098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 105/193] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:05 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:06.838148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:06.838709 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:06.845365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:06.847482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:06.847482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:06.847482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:06.847770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:06.848090 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:06.986412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:06.994644 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1c4c2fa5-79e2-43c5-8da4-103f637dfe48 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.160737 Sep 01 18:05:06.995205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 89/194] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:06 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:08.016556 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:08.017155 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:08.024181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:08.024900 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:08.025334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:08.026023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:08.026468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:08.026891 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:08.157487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:08.165757 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aac3b90a-04a9-495c-bb70-bc52744a0541 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.153117 Sep 01 18:05:08.166323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 106/195] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:08 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:09.191743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:09.191743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:09.194859 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:09.195555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:09.196228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:09.197155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:09.197703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:09.198418 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:09.353500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:09.361286 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ff8409be-5a56-4274-8926-ea518607c99f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.178829 Sep 01 18:05:09.374948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 90/196] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:09 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:10.385936 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:10.387009 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:10.395399 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:10.404226 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:10.409812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:10.410845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:10.412976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:10.413790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:10.557648 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:10.565369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-70699158-a11d-478a-a8d6-edd6a3c1f578 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.185883 Sep 01 18:05:10.565917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 107/197] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:10 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:11.126886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:11.126886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:11.129668 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:11.130358 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:11.130798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:11.134364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:11.134364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:11.134364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:11.160392 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:05:11.537690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-43da1403-dce5-4a74-8634-47adbfd23e7e tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "DELETE /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 204 len: 0 microversion: 2.1 time: 0.419528 Sep 01 18:05:11.538473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 91/198] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:05:11 2022] DELETE /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:05:11.551237 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:11.551845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:11.557874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:11.558352 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:11.558781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:11.559458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:11.559908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:11.560351 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:11.587411 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:11.588357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:11.595166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:11.595740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:11.597102 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:11.598308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:11.598956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:11.599388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:11.720434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:11.730045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bc77ba01-281b-4bf9-8f03-4f5d70c01dda tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1553 microversion: 2.1 time: 0.182662 Sep 01 18:05:11.730898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 108/199] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:11 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:11.759497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:11.775581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-57641666-9029-4518-8c5c-50de374bb6c5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.192599 Sep 01 18:05:11.776162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 92/200] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:11 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:12.751094 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:12.751619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:12.758371 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:12.758858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:12.759293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:12.760021 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:12.760459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:12.760891 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:12.820170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:12.820170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:12.820170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:12.820170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:12.821070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:12.821070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:12.821070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:12.821070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:12.922263 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:12.931134 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7b852d5c-7aa4-4f10-9363-01d094077055 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1553 microversion: 2.1 time: 0.184033 Sep 01 18:05:12.932000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 109/201] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:12 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:12.988692 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:12.999470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4d89c416-90e3-4ccb-b4af-9a0aa1beb032 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.204280 Sep 01 18:05:13.000055 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 93/202] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:12 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:13.953605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:13.954347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:13.962965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:13.962965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:13.962965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:13.963166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:13.963727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:13.964158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:14.020754 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:14.021937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:14.032564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:14.032564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:14.032564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:14.032564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:14.033347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:14.034533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:14.106752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:14.116811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-485fb65a-899c-4f1f-9482-03638c4e87ef tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1553 microversion: 2.1 time: 0.168211 Sep 01 18:05:14.121124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 110/203] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:13 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:14.180523 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:14.188297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c8bba276-41f0-4ce4-bd47-0f1f87c7764f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.171740 Sep 01 18:05:14.188889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 94/204] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:14 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:15.137861 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:15.139527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:15.162093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:15.162093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:15.162093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:15.162093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:15.162444 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:15.162444 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:15.211284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:15.211930 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:15.219243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:15.219733 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:15.220168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:15.220902 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:15.222094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:15.222504 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:15.257145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:15.390368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:15.412495 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-970a9ac1-8642-469d-a1b7-29cac031b542 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1553 microversion: 2.1 time: 0.278418 Sep 01 18:05:15.413364 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 111/205] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:15 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:15.460826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-5dd75366-63bd-4640-9a23-ee1c7fd5e670 req-cb8b062d-521a-45a7-8346-ae5c6c74dc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cf4db5-1407-4e35-a751-313dc207527d", "name": "network-vif-deleted", "tag": "dc3bf96d-bcdb-477d-bc5a-61185c9768fb"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:05:15.474422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5dd75366-63bd-4640-9a23-ee1c7fd5e670 req-cb8b062d-521a-45a7-8346-ae5c6c74dc5d service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:15.474899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5dd75366-63bd-4640-9a23-ee1c7fd5e670 req-cb8b062d-521a-45a7-8346-ae5c6c74dc5d service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:15.475334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5dd75366-63bd-4640-9a23-ee1c7fd5e670 req-cb8b062d-521a-45a7-8346-ae5c6c74dc5d service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:15.492287 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-5dd75366-63bd-4640-9a23-ee1c7fd5e670 req-cb8b062d-521a-45a7-8346-ae5c6c74dc5d service nova] Creating event network-vif-deleted:dc3bf96d-bcdb-477d-bc5a-61185c9768fb for instance 83cf4db5-1407-4e35-a751-313dc207527d on hv-cinder-74915 Sep 01 18:05:15.500217 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-5dd75366-63bd-4640-9a23-ee1c7fd5e670 req-cb8b062d-521a-45a7-8346-ae5c6c74dc5d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046511 Sep 01 18:05:15.502164 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 112/206] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:05:15.505798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:15.515650 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-eac62161-fa50-400d-8f96-b40b97c99bb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.309848 Sep 01 18:05:15.519435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 95/207] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:15 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:16.440033 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:16.440757 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:16.447686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:16.448339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:16.449114 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:16.450331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:16.451146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:16.460230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:16.497586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:16.497586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:16.497586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:16.497586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lazy-loading 'fault' on Instance uuid 83cf4db5-1407-4e35-a751-313dc207527d {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:05:16.540801 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:16.547098 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:16.548849 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:16.548975 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:16.549965 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:16.550995 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:16.552237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:16.552908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:16.553508 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:16.575561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cb0de2cf-0420-4970-b1bd-fef59a732fe4 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1350 microversion: 2.1 time: 0.139793 Sep 01 18:05:16.589024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 113/208] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:16 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:16.718403 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:16.726885 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e706dec6-0991-4b39-a6bc-9205c58258e7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.190803 Sep 01 18:05:16.727452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 96/209] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:16 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:17.598132 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:17.598765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:17.605546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:17.609933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:17.609933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:17.609933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:17.609933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:17.610323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:17.639338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:17.639807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:17.640230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:17.640686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lazy-loading 'fault' on Instance uuid 83cf4db5-1407-4e35-a751-313dc207527d {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:05:17.680856 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af540344a27b48eba16db2861df2078b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c83a25c5f74e3396ebe8b0a3ee580e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:17.689057 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b6bfb6d-9650-477e-8657-17c0672b787d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 200 len: 1350 microversion: 2.1 time: 0.095287 Sep 01 18:05:17.689625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 114/210] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:17 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:17.747175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:17.747779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:17.754676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:17.755152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:17.755577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:17.756329 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:17.756768 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:17.757183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:17.889236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:17.897173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7e86abec-c645-4a13-b778-738876016aba tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.153991 Sep 01 18:05:17.897739 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 97/211] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:17 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:18.710367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:18.711043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:18.717307 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:18.720537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:18.720537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:18.720537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:18.720537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:18.720895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:18.733412 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] HTTP exception thrown: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Request method failure captured: Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d HTTP/1.1 Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQPgFtiC1FmckB61tXxoueL-Yw-NAAl_8Ws72nLJRwFrzEH-OoYcxIMmOzqzh0pSIArdwbtklSOG2xfbYVb7dp0RwclOWTlbkSjT6T2orSISnSYUx69lRjuzmvd0nbfs4RaVsupnTwhDX7P2Nuw8YK67CfS7WlfZWGAb3HgwOIdbkY Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:05:18.748544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_62c83a25c5f74e3396ebe8b0a3ee580e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: af540344a27b48eba16db2861df2078b Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:18.750050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '83cf4db5-1407-4e35-a751-313dc207527d'} Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:05:18.752714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:18.754360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:18.755659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Returning 404 to user: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:05:18.755659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-37cd9a1e-d6cf-497d-8956-25ef9e91278d tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 404 len: 111 microversion: 2.1 time: 0.044505 Sep 01 18:05:18.755659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 115/212] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:18 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:05:18.917818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:18.918418 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:18.925400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:18.925874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:18.926300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:18.926980 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:18.927422 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:18.927839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:19.074581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:19.088356 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f4692a0b-b82e-4ff5-9d69-8618be0b9c53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.174321 Sep 01 18:05:19.122408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 98/213] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:18 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:19.197603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:19.199746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:19.205829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:19.206391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:19.206725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:19.207403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:19.207849 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:19.208265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:19.222345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] HTTP exception thrown: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Request method failure captured: Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d/os-volume_attachments HTTP/1.1 Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQPgFtiC1FmckB61tXxoueL-Yw-NAAl_8Ws72nLJRwFrzEH-OoYcxIMmOzqzh0pSIArdwbtklSOG2xfbYVb7dp0RwclOWTlbkSjT6T2orSISnSYUx69lRjuzmvd0nbfs4RaVsupnTwhDX7P2Nuw8YK67CfS7WlfZWGAb3HgwOIdbkY Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:05:19.223884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_62c83a25c5f74e3396ebe8b0a3ee580e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: af540344a27b48eba16db2861df2078b Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:19.225230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'server_id': '83cf4db5-1407-4e35-a751-313dc207527d'} Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:05:19.226085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:19.227374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:19.228689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Returning 404 to user: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:05:19.228689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d44c9b98-94d6-4a78-b992-8eac6814ded6 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031740 Sep 01 18:05:19.228689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 116/214] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:05:19 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:05:20.126690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:20.127825 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:20.134208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:20.134679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:20.135146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:20.135826 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:20.136268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:20.136707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:20.302240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:20.312968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dab6919d-e3b3-4652-9e08-1487fba43a0e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.190134 Sep 01 18:05:20.327399 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 99/215] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:20 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:21.335481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:21.336081 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:21.342059 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:21.342532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:21.342956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:21.343632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:21.344074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:21.344528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:21.477130 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:21.484670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-633c1924-4a78-4207-880b-ea2e3c927496 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.153113 Sep 01 18:05:21.485238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 117/216] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:21 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:22.505404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:22.514425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:22.514425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:22.514425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:22.514425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:22.514870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:22.514870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:22.514870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:22.656150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:22.665082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1fe41260-b9f8-466a-b174-6fb6e5d9577e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.163962 Sep 01 18:05:22.665676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 100/217] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:22 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:23.685361 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:23.685973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:23.692194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:23.692729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:23.693189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:23.693879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:23.694334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:23.694758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:23.825276 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:23.833003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0404a6b2-1458-4e31-887f-7e521bf25375 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.151535 Sep 01 18:05:23.833790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 118/218] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:23 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:24.854708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:24.855325 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:24.862898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:24.863394 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:24.863826 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:24.864553 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:24.865005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:24.865447 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:24.997762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:25.007607 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b5af8914-a533-49b6-afef-f54754476fab tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.156792 Sep 01 18:05:25.008446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 101/219] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:24 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:26.029025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:26.029626 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:26.036097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:26.036618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:26.037050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:26.037738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:26.038186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:26.038607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:26.189228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:26.197504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6a44ea31-7e24-459a-89b4-b89c41575a10 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.172741 Sep 01 18:05:26.198076 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 119/220] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:26 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:27.006070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:27.006543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:27.012901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:27.013373 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:27.013798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:27.014475 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:27.014910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:27.015321 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:27.029231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] HTTP exception thrown: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Request method failure captured: Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: DELETE /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d HTTP/1.1 Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQPgFtiC1FmckB61tXxoueL-Yw-NAAl_8Ws72nLJRwFrzEH-OoYcxIMmOzqzh0pSIArdwbtklSOG2xfbYVb7dp0RwclOWTlbkSjT6T2orSISnSYUx69lRjuzmvd0nbfs4RaVsupnTwhDX7P2Nuw8YK67CfS7WlfZWGAb3HgwOIdbkY Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:05:27.034694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_62c83a25c5f74e3396ebe8b0a3ee580e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: af540344a27b48eba16db2861df2078b Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.036216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '83cf4db5-1407-4e35-a751-313dc207527d'} Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:05:27.037075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.038446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.040020 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Returning 404 to user: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:05:27.040020 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2e8b7edb-bd0b-411d-9fd8-0ca6126d6994 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "DELETE /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 404 len: 111 microversion: 2.1 time: 0.034095 Sep 01 18:05:27.040020 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 102/221] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:05:27 2022] DELETE /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:05:27.044476 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:27.045079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] [instance: 83cf4db5-1407-4e35-a751-313dc207527d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:27.051256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:27.051727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:27.052152 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:27.052883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:27.053403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:27.053815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:27.066995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] HTTP exception thrown: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Request method failure captured: Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d HTTP/1.1 Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQPgFtiC1FmckB61tXxoueL-Yw-NAAl_8Ws72nLJRwFrzEH-OoYcxIMmOzqzh0pSIArdwbtklSOG2xfbYVb7dp0RwclOWTlbkSjT6T2orSISnSYUx69lRjuzmvd0nbfs4RaVsupnTwhDX7P2Nuw8YK67CfS7WlfZWGAb3HgwOIdbkY Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:05:27.068514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_62c83a25c5f74e3396ebe8b0a3ee580e", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/62c83a25c5f74e3396ebe8b0a3ee580e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 62c83a25c5f74e3396ebe8b0a3ee580e Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-DeleteServersTestJSON-655118037 Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: af540344a27b48eba16db2861df2078b Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-DeleteServersTestJSON-655118037-project Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.070107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '83cf4db5-1407-4e35-a751-313dc207527d'} Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:05:27.071005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. Sep 01 18:05:27.072485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:05:27.073695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] Returning 404 to user: Instance 83cf4db5-1407-4e35-a751-313dc207527d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:05:27.073695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aa27791f-d708-4758-a99e-307c0f4b28b9 tempest-DeleteServersTestJSON-655118037 tempest-DeleteServersTestJSON-655118037-project] 10.222.0.15 "GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d" status: 404 len: 111 microversion: 2.1 time: 0.029164 Sep 01 18:05:27.073695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 120/222] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:27 2022] GET /compute/v2.1/servers/83cf4db5-1407-4e35-a751-313dc207527d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:05:27.219685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:27.221750 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:27.229928 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:27.242049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:27.242049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:27.242049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:27.242049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:27.242579 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:27.400010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:27.409718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a8e71015-28d3-4998-a34b-076bc076c77a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.194345 Sep 01 18:05:27.410366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 103/223] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:27 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:28.444343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:28.445080 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:28.451754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:28.452345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:28.452837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:28.453754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:28.454679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:28.455253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:28.649893 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:28.653466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:28.658936 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dfe0c31b-66cb-48ca-a073-70d1a17768d3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.217947 Sep 01 18:05:28.659507 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 121/224] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:28 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:29.681455 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:29.682790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:29.690886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:29.692123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:29.692595 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:29.693298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:29.693896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:29.694466 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:29.930711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:29.939312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-75c99059-219b-4a67-8476-84ebbb77d25e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.261366 Sep 01 18:05:29.940390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 104/225] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:29 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:30.964467 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:30.965509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:30.973949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=48 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:30.997644 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:30.998381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:30.998979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:31.000265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:31.000892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:31.001466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:31.309273 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:31.317859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6c5ca239-8e7f-46fe-9cf8-8ffa4da861d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.361839 Sep 01 18:05:31.330483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 122/226] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:30 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:32.339367 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:32.340538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:32.349578 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:32.351349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:32.351993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:32.352867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:32.353823 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:32.363665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:32.364287 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:32.547308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:32.559122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3de1a36f-a6ca-4b24-8c84-62a6b3377f5a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.223738 Sep 01 18:05:32.573167 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 105/227] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:32 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:33.583481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:33.584242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:33.591402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:33.592075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:33.592636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:33.593541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:33.594160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:33.594590 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:33.785754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:33.798509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b87fe24b-f3ee-44b3-8cf5-bca0e2da8b3a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.219671 Sep 01 18:05:33.800120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 123/228] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:33 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:34.821852 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:34.822466 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:34.829584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:34.830155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:34.830613 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:34.831490 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:34.831940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:34.832385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:34.960775 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:34.968892 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9aec492d-d87b-491a-b551-f865f7335789 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1523 microversion: 2.1 time: 0.151325 Sep 01 18:05:34.980596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 106/229] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:34 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:35.990592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:35.991103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:35.997089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:35.997572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:35.998000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:36.000772 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:36.000772 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:36.000772 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:36.159106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:36.166819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f8ac9c6d-e584-467e-ad6c-bc51640620f4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1503 microversion: 2.1 time: 0.180153 Sep 01 18:05:36.167964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 124/230] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:35 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:36.196985 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:36.197641 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:36.203962 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:36.204479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:36.204969 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:36.205659 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:36.206107 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:36.206528 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:36.563762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:36.575370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7d629c67-c253-444b-8f9b-5ce5c753737a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1515 microversion: 2.1 time: 0.382157 Sep 01 18:05:36.577213 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 107/231] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:36 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:40.846558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:05:40.848769 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:40.854766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:40.855304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:40.855654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:40.858966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:40.858966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:40.858966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:40.885453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lazy-loading 'flavor' on Instance uuid bf4f11d5-97c7-4f32-86bd-71967d45e5ed {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:05:41.338290 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c88996d7-93e1-4e7a-bc83-23b34dafdd66 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed/action" status: 200 len: 32 microversion: 2.1 time: 0.495735 Sep 01 18:05:41.342453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 125/232] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:05:40 2022] POST /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed/action => generated 32 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:05:41.350162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:41.350945 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:41.359968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:41.360630 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:41.361109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:41.366732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:41.366732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:41.366732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:41.599015 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:41.609467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-87d23e1b-dddd-4339-b821-b40268b3ca35 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.264360 Sep 01 18:05:41.610114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 108/233] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:41 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:42.631466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:42.632301 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:42.642419 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:42.647168 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:42.647690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:42.649069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:42.652584 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:42.653454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:42.858331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:42.866814 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7604fe6d-5b76-46ec-8cb7-b44584a8eb5c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.239612 Sep 01 18:05:42.867631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 126/234] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:42 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:43.890124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:43.890979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:43.899056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:43.899895 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:43.909197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:43.909197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:43.909197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:43.909197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:44.127038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:44.137646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bbbb8d47-cbd8-42f0-a414-c08f57b8622c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.251492 Sep 01 18:05:44.143376 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 109/235] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:43 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:45.166331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:45.167049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:45.177347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:45.177908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:45.179207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:45.180122 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:45.180984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:45.182115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:45.362668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:45.377418 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a4299223-b6da-4fef-a882-67ba224be964 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.212582 Sep 01 18:05:45.377418 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 127/236] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:45 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:46.395684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:46.398825 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:46.410512 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:46.411280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:46.411922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:46.412882 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:46.413559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:46.414168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:46.592426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:46.601997 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-44cde2a1-cb22-4944-adb8-4a37a8dfdf14 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.210811 Sep 01 18:05:46.603316 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 110/237] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:46 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:47.627018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:47.628392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:47.639546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:47.640620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:47.641490 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:47.642927 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:47.652744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:47.653368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:47.878022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:47.887922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d5961700-90d0-4bc5-8baa-f139501b6059 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.267567 Sep 01 18:05:47.904483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 128/238] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:47 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:48.915134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:48.916393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:48.926224 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:48.928573 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:48.929888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:48.932247 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:48.932945 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:48.933529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:48.951292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=91 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:05:49.222481 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:49.277374 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-36ca2e68-8bce-4e6f-983e-f7e48ba4d4fc tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.366073 Sep 01 18:05:49.278988 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 111/239] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:48 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:50.300929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:50.302079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:50.308523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:50.309488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:50.312211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:50.313180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:50.313885 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:50.314514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:50.506596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:50.518865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-23daeff9-689a-431f-8d9f-01fba3f5a6ca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.217254 Sep 01 18:05:50.530065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 129/240] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:50 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:51.541405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:51.542608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:51.550369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:51.552597 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:51.553037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:51.553776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:51.554226 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:51.554652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:51.764126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:51.774364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f31eb816-4adc-4663-914f-7f1009002008 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.238480 Sep 01 18:05:51.789621 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 112/241] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:51 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:52.799800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:52.801145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:52.831719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:52.832272 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:52.832747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:52.833490 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:52.842886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:52.842886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:53.146016 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:53.156505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-29b61137-5b3e-4a69-aad6-8ae25476d1d9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.362105 Sep 01 18:05:53.165682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 130/242] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:52 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:53.717679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-83fa18c5-d7e9-4579-9b8b-cf6691b69f50 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Action: 'create', calling method: .version_select at 0x7f446a98f670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1874762970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs4NXBfSgmfjVuNPdrT8a4GO75CqM5NYZBz5YBCmQNUopI62Rf8EWLHk5DNqX+jK6+JErACuUcGrTjK6/+9YfvLYDM0SYMbCDk51OT0goXS/iI8xdi+Q1AvIN6Ncs1PKA=="}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:05:53.745257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-83fa18c5-d7e9-4579-9b8b-cf6691b69f50 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:05:53.758715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-83fa18c5-d7e9-4579-9b8b-cf6691b69f50 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for user 14bd04e951254ec5bc29999bceeea214 and project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:05:53.931937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-83fa18c5-d7e9-4579-9b8b-cf6691b69f50 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.464566 Sep 01 18:05:53.932597 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 113/243] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:05:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:05:54.186193 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:54.186826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:54.193501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:54.193973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:54.194400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:54.195080 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:54.195523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:54.195935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:54.363371 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:54.371965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dfae3075-bfcf-4000-8ed9-4693718ccda4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.189729 Sep 01 18:05:54.372577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 131/244] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:54 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:55.393639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:55.394246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:55.401117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:55.401594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:55.402023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:55.402711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:55.403157 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:55.403577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:55.537580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:55.556922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fd9e05da-ef9d-4cfe-bae0-7e9373bea5a4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.163958 Sep 01 18:05:55.556922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 114/245] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:55 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:56.574115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:56.574704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:56.581692 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:56.582175 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:56.582605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:56.583298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:56.583741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:56.584162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:56.869916 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:56.878783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8fbf26f9-a926-458d-bc14-7c5a3f1532af tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1501 microversion: 2.1 time: 0.308400 Sep 01 18:05:56.898460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 132/246] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:56 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:56.906922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dab46aef-2423-49dd-ab8a-b7bda74bd03a"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:05:56.911248 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:56.932060 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:56.932970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:56.933705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:56.934823 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:56.935476 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:56.936874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:56.969907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] HTTP exception thrown: Cannot 'attach_volume' instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed while it is in vm_state rescued Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Request method failure captured: Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: POST /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed/os-volume_attachments HTTP/1.1 Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 74 Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQRvIYMjYUKZZPjSLJWG0HYMhOZB6twqfznx3zIOmiPYq3_YozI0xfIaj3eQibvZFsbmmi8hquDRVj-w7wGqLbD3xOl9FjWWqfR1BAox1LBCrPSQIm7iKLxXG0_GvXaxqgP7ju5MsnCZqu4E0vjZaHq7X9QbDGZVVGaZHdjbfzv2eI Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:05:56.972708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6749f998c37a43428eb7e1233408c560", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6749f998c37a43428eb7e1233408c560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 01f1499bbf89441dae30433aaf1d29a7 Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {"volumeAttachment": {"volumeId": "dab46aef-2423-49dd-ab8a-b7bda74bd03a"}} Sep 01 18:05:56.974058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Cannot 'attach_volume' instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed while it is in vm_state rescued Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'server_id': 'bf4f11d5-97c7-4f32-86bd-71967d45e5ed', 'body': {'volumeAttachment': {'volumeId': 'dab46aef-2423-49dd-ab8a-b7bda74bd03a'}}} Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:05:56.974779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed while it is in vm_state rescued Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:05:56.975932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:05:56.977045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:05:56.977045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:05:56.977045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed while it is in vm_state rescued Sep 01 18:05:56.977045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:05:56.977045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Returning 409 to user: Cannot 'attach_volume' instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed while it is in vm_state rescued {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:05:56.977045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2d2af186-2027-423e-8a36-ab89da1af4b7 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072530 Sep 01 18:05:56.977045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 115/247] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:05:56 2022] POST /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 18:05:56.983345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:05:56.983881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:56.990595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:56.991089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:56.991649 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:56.992640 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:56.993100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:56.993626 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:57.313196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c518a8c5-c037-4cba-b0a8-229659098916 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed/action" status: 202 len: 0 microversion: 2.1 time: 0.328414 Sep 01 18:05:57.313196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 133/248] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:05:56 2022] POST /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 18:05:57.318908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:57.319861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:57.327516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:57.327978 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:57.328433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:57.329696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:57.330124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:57.337365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:57.543799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:57.552018 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ced22773-222a-479f-b890-2af354ed8ac9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1509 microversion: 2.1 time: 0.237019 Sep 01 18:05:57.557882 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 116/249] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:57 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:05:58.583516 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:58.584952 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:58.594322 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:58.595512 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:58.596123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:58.596965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:58.597672 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:58.598091 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:58.806831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:05:58.834484 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e462f438-9c0f-4bbf-af02-6fe3a5686c22 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1509 microversion: 2.1 time: 0.247969 Sep 01 18:05:58.835146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 134/250] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:58 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:05:59.858050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:05:59.859412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:05:59.870062 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:59.871536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:59.872003 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:05:59.872760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:05:59.873428 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:05:59.874706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:00.071610 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:00.081555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9bf10b99-dab1-47bb-bb7f-b3ca167df163 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1509 microversion: 2.1 time: 0.227957 Sep 01 18:06:00.082443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 117/251] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:05:59 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:01.120774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:01.120774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:01.120774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:01.120774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:01.122043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:01.122043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:01.122043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:01.122043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:01.122472 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:01.309068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:01.317584 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-79438401-4a5b-4146-8199-81612b734891 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1509 microversion: 2.1 time: 0.214041 Sep 01 18:06:01.318668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 135/252] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:01 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:02.339059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:02.339671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:02.348904 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:02.349435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:02.349821 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:02.350521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:02.350966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:02.351383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:02.508575 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:02.516630 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d8309ade-f597-45fd-b0b1-4af295da9e53 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1515 microversion: 2.1 time: 0.181188 Sep 01 18:06:02.517276 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 118/253] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:02 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:07.599874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-72d12399-57b3-440e-bce2-b781b314f046 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'create', calling method: .version_select at 0x7f446aa033a0>, body: {"keypair": {"name": "tempest-keypair-1280764308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqzY+L7gXbYsDR7ZuKzhnPjjbBjh3M9DonA6shOGciyuogJf9nwhvUIYaWN+vv50/vAdGnUwwmrFMtOP2zImea8fedoRPvnL+nc6izVlrLRa7BICzyEfpzznGh7ylHg1Q=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:07.610016 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=28 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:07.634793 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-72d12399-57b3-440e-bce2-b781b314f046 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for project 6749f998c37a43428eb7e1233408c560. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:06:07.639713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-72d12399-57b3-440e-bce2-b781b314f046 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for user 01f1499bbf89441dae30433aaf1d29a7 and project 6749f998c37a43428eb7e1233408c560. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:06:07.805045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-72d12399-57b3-440e-bce2-b781b314f046 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.208991 Sep 01 18:06:07.816185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 136/254] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:06:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:06:11.132565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1869050463", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6f1c66b-8614-4e3c-b35f-b4f9c8f42a21"}], "security_groups": [{"name": "tempest-securitygroup--1784674986"}], "key_name": "tempest-keypair-1280764308", "user_data": "}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:11.152200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=4 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:11.153581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:11.273324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] validate_networks() for [('d6f1c66b-8614-4e3c-b35f-b4f9c8f42a21', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:06:11.695407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:06:11.695407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:06:11.695407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:06:11.695407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:06:11.695407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:06:11.701300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:11.701784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:11.702212 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:11.702950 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:11.703395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:11.703851 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:11.720726 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for project 6749f998c37a43428eb7e1233408c560. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:06:11.724591 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Getting quotas for user 01f1499bbf89441dae30433aaf1d29a7 and project 6749f998c37a43428eb7e1233408c560. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:06:11.735833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:06:11.738152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:06:11.990063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3c2bf50c-dd16-4e0d-83a2-40800c5de526 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.864849 Sep 01 18:06:11.990795 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 119/255] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:06:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:06:12.002212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6cf8eebe-dc38-4870-ba68-8cc5ff6445b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:12.003377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6cf8eebe-dc38-4870-ba68-8cc5ff6445b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:12.066815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6cf8eebe-dc38-4870-ba68-8cc5ff6445b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:12.074725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6cf8eebe-dc38-4870-ba68-8cc5ff6445b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1246 microversion: 2.1 time: 0.076949 Sep 01 18:06:12.075349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 137/256] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:11 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:13.103466 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-37a102de-887e-48e3-9b8d-4c6f8ec28463 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:13.104077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-37a102de-887e-48e3-9b8d-4c6f8ec28463 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:13.163271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-37a102de-887e-48e3-9b8d-4c6f8ec28463 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:13.170286 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-37a102de-887e-48e3-9b8d-4c6f8ec28463 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1246 microversion: 2.1 time: 0.072032 Sep 01 18:06:13.170849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 120/257] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:13 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:14.191107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:14.191892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:14.212574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:14.212574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:14.212574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:14.212574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:14.212989 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:14.212989 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:14.268021 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:14.272923 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bef2172c-cb8d-4d4c-aa6f-7781caffb839 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1242 microversion: 2.1 time: 0.085815 Sep 01 18:06:14.280737 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 138/258] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:14 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:15.295593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:15.296712 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:15.304174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:15.304700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:15.305140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:15.305851 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:15.306301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:15.306724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:15.380065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:15.390449 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e9ca44c2-b8d1-480d-85b8-262d6881f180 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1298 microversion: 2.1 time: 0.099185 Sep 01 18:06:15.391534 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 121/259] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:15 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:16.411851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:16.412536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:16.418588 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:16.419068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:16.419504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:16.420192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:16.420679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:16.421102 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:16.496353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:16.504811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-210926ba-350c-4b06-8235-30a3e68e9c2f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1306 microversion: 2.1 time: 0.097581 Sep 01 18:06:16.505585 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 139/260] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:16 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:17.526136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:17.526708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:17.533389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:17.534488 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:17.534488 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:17.535038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:17.535481 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:17.535898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:17.668205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:17.676660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fe9c3a1a-c331-4d86-bbfb-ad15d4d535b4 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1384 microversion: 2.1 time: 0.154404 Sep 01 18:06:17.677217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 122/261] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:17 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1384 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:18.707846 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:18.708476 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:18.714839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:18.715328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:18.715791 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:18.716570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:18.717021 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:18.717467 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:18.848705 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:18.856457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d55bef35-aad9-41b8-a17d-e737242284e0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.152512 Sep 01 18:06:18.856965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 140/262] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:18 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:18.928142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-2fe6bb20-0194-447e-a3e8-e398c17eeaa6 req-51372f29-2a51-44cb-a1ce-933bb2460c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0e643e-dad7-4451-abce-e4481f372f3d", "tag": "5eeacdba-549e-4f16-9803-cf2a8f4e4adc"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:18.940963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2fe6bb20-0194-447e-a3e8-e398c17eeaa6 req-51372f29-2a51-44cb-a1ce-933bb2460c40 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:18.941439 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2fe6bb20-0194-447e-a3e8-e398c17eeaa6 req-51372f29-2a51-44cb-a1ce-933bb2460c40 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:18.941874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2fe6bb20-0194-447e-a3e8-e398c17eeaa6 req-51372f29-2a51-44cb-a1ce-933bb2460c40 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:18.952866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-2fe6bb20-0194-447e-a3e8-e398c17eeaa6 req-51372f29-2a51-44cb-a1ce-933bb2460c40 service nova] Creating event network-changed:5eeacdba-549e-4f16-9803-cf2a8f4e4adc for instance 6d0e643e-dad7-4451-abce-e4481f372f3d on hv-cinder-74915 Sep 01 18:06:18.958347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-2fe6bb20-0194-447e-a3e8-e398c17eeaa6 req-51372f29-2a51-44cb-a1ce-933bb2460c40 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033839 Sep 01 18:06:18.958934 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 123/263] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:06:19.878530 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:19.879055 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:19.885019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:19.885492 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:19.886104 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:19.902207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:19.902207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:19.902207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:20.013964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:20.021833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c489fc5d-0fb6-49e5-8307-0b2ce434a51f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.148019 Sep 01 18:06:20.022392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 141/264] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:19 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:21.044268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:21.045066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:21.052300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:21.053350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:21.053845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:21.054610 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:21.055150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:21.055650 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:21.195263 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:21.213765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9ba27117-0f73-4cf7-9ec4-e817a449556d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.174358 Sep 01 18:06:21.223382 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 124/265] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:21 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:22.244392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:22.245050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:22.246946 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:22.253434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:22.253923 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:22.254355 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:22.255054 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:22.255678 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:22.256103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:22.410309 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:22.417949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-150c1c1d-158b-43b9-90a7-d83fca082cf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.177511 Sep 01 18:06:22.418542 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 142/266] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:22 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:23.438324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:23.438933 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:23.440992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:23.442171 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=8 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:23.446967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:23.447447 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:23.447877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:23.448593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:23.449041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:23.456870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:23.456870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=62 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:23.616839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:23.624787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8568524a-c8c9-4d65-a94f-2aca11a3b4b2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.190093 Sep 01 18:06:23.628349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 125/267] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:23 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:24.646124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:24.646725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:24.653024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:24.653517 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:24.653927 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:24.654604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:24.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:24.655467 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:24.805146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:24.812865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b61d18be-9d32-416c-b0e7-ed88d57b3881 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.170745 Sep 01 18:06:24.813447 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 143/268] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:24 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:25.832733 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:25.833348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:25.841423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:25.841902 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:25.842327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:25.843017 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:25.843467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:25.843893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:25.970736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:25.978298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3d6d354a-5995-45cd-8a37-4eb8bed40327 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.149393 Sep 01 18:06:25.979062 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 126/269] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:25 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:26.999044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:26.999651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:27.006396 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:27.006995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:27.007479 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:27.008240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:27.008889 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:27.009311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:27.147359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:27.155521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-faf0072f-05f0-45c8-970f-4cc810bbff40 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.160304 Sep 01 18:06:27.156092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 144/270] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:26 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:28.057153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-132316230", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "networks": [{"uuid": "3f79830d-12b2-4025-87aa-90dccfaee569"}]}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:28.119532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] validate_networks() for [('3f79830d-12b2-4025-87aa-90dccfaee569', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:06:28.176388 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:28.177017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:28.182877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:28.183352 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:28.183780 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:28.184532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:28.184977 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:28.185397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:28.322249 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:28.330953 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7763da7a-c11b-4e1c-9705-06bc82052e71 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.158559 Sep 01 18:06:28.332401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 145/271] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:28 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:28.478557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:06:28.478972 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:06:28.482669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:06:28.482669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:06:28.482669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:06:28.489518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:28.490065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:28.490500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:28.491214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:28.491659 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:28.492077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:28.509223 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Getting quotas for project ab11fffacccb4f248d76d99553bdb2a9. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:06:28.513215 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Getting quotas for user 6201e7d144874370b4da432a529014d2 and project ab11fffacccb4f248d76d99553bdb2a9. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:06:28.524657 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:06:28.526911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:06:28.709267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ebcc735d-968c-43dc-8a18-70a4b5e63dc8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656082 Sep 01 18:06:28.709916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 127/272] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:06:28.720741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b3868850-5be9-4b24-9805-b6e0e679d7ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:28.721343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b3868850-5be9-4b24-9805-b6e0e679d7ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:28.774806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b3868850-5be9-4b24-9805-b6e0e679d7ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:28.781934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b3868850-5be9-4b24-9805-b6e0e679d7ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1218 microversion: 2.1 time: 0.065200 Sep 01 18:06:28.782552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 146/273] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:28 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:29.355580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:29.356178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:29.362855 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:29.363331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:29.363752 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:29.364510 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:29.365131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:29.365552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:29.505796 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:29.513734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ee858dcb-4acc-4720-8aab-cd2b151dc0c3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.162706 Sep 01 18:06:29.514334 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 128/274] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:29 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:29.806694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-30e4b1f7-c841-40f9-b27e-f28748146bdf tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:29.807304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-30e4b1f7-c841-40f9-b27e-f28748146bdf tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:29.862262 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-30e4b1f7-c841-40f9-b27e-f28748146bdf tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:29.870191 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-30e4b1f7-c841-40f9-b27e-f28748146bdf tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1218 microversion: 2.1 time: 0.067484 Sep 01 18:06:29.871060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 147/275] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:29 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:30.534974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:30.535583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:30.541960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:30.542489 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:30.542918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:30.543604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:30.544060 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:30.544511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:30.676084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:30.684011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f19ac0d2-2399-4846-9a70-c5ae2c497beb tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.153271 Sep 01 18:06:30.684611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 129/276] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:30 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:30.890543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:30.891145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:30.897175 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:30.897657 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:30.898089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:30.898818 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:30.899268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:30.899690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:30.960363 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:30.968265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-60a14e45-bcda-4098-9ac8-77e6b3a44e95 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.081684 Sep 01 18:06:30.968920 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 148/277] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:30 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:31.704124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:31.704748 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:31.711747 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:31.712222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:31.712756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:31.713440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:31.713881 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:31.714295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:31.842779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:31.850732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a625ce86-308f-4035-bd4a-92dd23a263f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.150418 Sep 01 18:06:31.851304 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 130/278] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:31 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:31.989074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:31.989689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:31.995567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:31.996052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:31.996534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:31.997228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:31.997678 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:31.998103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:32.059917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:32.068030 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-14286447-9ee9-4917-9363-0a9fc3862187 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.083192 Sep 01 18:06:32.068617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 149/279] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:31 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:32.870933 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:32.871529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:32.877838 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:32.878306 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:32.878734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:32.879637 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:32.880080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:32.880535 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:33.006121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:33.013742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-94eee91d-e7b2-4ad6-a897-b2ac11b162a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.146655 Sep 01 18:06:33.014351 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 131/280] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:32 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:33.088924 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:33.089540 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:33.095694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:33.096206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:33.096677 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:33.097375 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:33.098511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:33.098952 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:33.165478 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:33.173096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-85c68ca9-7b92-403c-9fe1-6f5e33926dcb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.088412 Sep 01 18:06:33.173653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 150/281] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:33 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:34.034888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:34.035872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:34.042498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:34.042982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:34.043417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:34.044158 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:34.044636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:34.045063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:34.202347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:34.203027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:34.209234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:34.209783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:34.210277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:34.210967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:34.211412 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:34.211825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:34.276520 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:34.284625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6d248484-df8a-4e58-9623-870b3445e5ec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.086460 Sep 01 18:06:34.285846 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 151/282] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:34 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:34.324203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:34.331991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1e55cd1e-e0be-4fe3-80d6-b2e922bf678f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.301172 Sep 01 18:06:34.332651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 132/283] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:34 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:35.307057 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:35.307647 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:35.313555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:35.314023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:35.314449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:35.315119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:35.315569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:35.315982 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:35.352802 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:35.353514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:35.360011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:35.360648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:35.361083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:35.361772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:35.362222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:35.362647 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:35.377136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:35.385495 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-98801940-88aa-43e9-b1ca-fcd85d0978ac tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.082723 Sep 01 18:06:35.386056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 152/284] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:35 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:35.490046 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:35.497776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dcac1923-0615-41f6-8b47-80b79aaf4015 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.148707 Sep 01 18:06:35.498408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 133/285] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:35 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:36.405962 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:36.406555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:36.412751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:36.413269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:36.413703 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:36.414383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:36.414833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:36.415256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:36.473609 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:36.481145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-347df3f4-409b-4f12-a335-dfa568cb54d7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.079003 Sep 01 18:06:36.481703 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 153/286] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:36 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:36.518770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:36.519388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:36.526494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:36.527079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:36.527401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:36.528094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:36.528577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:36.529000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:36.656424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:36.664231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e2aff63d-173a-4e4e-ac32-a911315d3fc6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.149310 Sep 01 18:06:36.664818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 134/287] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:36 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:37.501609 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:37.502216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:37.508281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:37.508726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:37.509153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:37.509826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:37.510271 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:37.510689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:37.597181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:37.597181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b0b2932-ba1b-4431-be97-3369e8428c80 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.080359 Sep 01 18:06:37.597181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 154/288] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:37 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:37.684822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:37.685429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:37.691692 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:37.692157 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:37.692622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:37.693300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:37.693747 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:37.694158 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:37.828249 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:37.836435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e85fbe4f-f909-412e-8c48-4c88f3f1a79f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.155359 Sep 01 18:06:37.837005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 135/289] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:37 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:38.616125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:38.617005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:38.622932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:38.623417 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:38.623865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:38.624614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:38.625077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:38.625519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:38.688033 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:38.690260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:38.696807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d3b32d65-42a6-4afe-8c68-b01863c271ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1222 microversion: 2.1 time: 0.084847 Sep 01 18:06:38.697372 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 155/290] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:38 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:38.857029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:38.857685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:38.859537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:38.860189 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:38.865786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:38.866276 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:38.866754 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:38.867469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:38.867909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:38.868358 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:38.999807 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:39.008042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d0c2b3fd-d599-43d5-ab64-b1306f574be6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.154946 Sep 01 18:06:39.008633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 136/291] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:38 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:39.650502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1202997080", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1874762970", "security_groups": [{"name": "tempest-secgroup-smoke-1538754185"}], "block_device_mapping_v2": [{"uuid": "ad197817-3a02-4d33-a3c5-83ad6db243b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b81e98a-02f9-4baf-b5a3-9da306ffc4e2"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:39.724981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:39.726103 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:39.733684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:39.734333 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:39.734918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:39.735877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:39.736520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:39.737278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:39.781109 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] validate_networks() for [('2b81e98a-02f9-4baf-b5a3-9da306ffc4e2', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:06:39.818275 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:39.827264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-274f0c53-7d9f-4373-a58d-b0ee223c34df tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1214 microversion: 2.1 time: 0.113212 Sep 01 18:06:39.828703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 137/292] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:39 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:39.866702 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:40.028678 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:40.029282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:40.037232 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:40.037720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:40.038153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:40.039075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:40.039852 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:40.040455 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:40.181338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:40.189339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0d98a823-788d-4326-9355-2ae7127b7838 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.164523 Sep 01 18:06:40.204355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 138/293] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:40 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:40.395550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:06:40.395985 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:06:40.396480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:06:40.396884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:06:40.397289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:06:40.405864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:40.406338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:40.406762 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:40.407670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:40.408120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:40.408817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:40.426183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:06:40.430520 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for user 14bd04e951254ec5bc29999bceeea214 and project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:06:40.490445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:06:40.492653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad197817-3a02-4d33-a3c5-83ad6db243b9',volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:06:40.850828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:40.851545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:40.857693 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:40.858177 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:40.858606 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:40.859293 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:40.859739 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:40.863041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:40.935396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:40.935396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-db951a89-320b-4537-af97-600dae4f3bb7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1270 microversion: 2.1 time: 0.082946 Sep 01 18:06:40.935396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 139/294] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:40 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:41.210105 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:41.211407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:41.217790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:41.218270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:41.218697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:41.219383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:41.219833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:41.220249 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:41.321452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2cec54ef-23c0-4f55-a07a-c21763168b76 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.674750 Sep 01 18:06:41.322899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 156/295] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:06:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:06:41.341075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4a82c8f2-31ee-452e-a68d-933402bfc016 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:41.349100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4a82c8f2-31ee-452e-a68d-933402bfc016 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:41.391146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:41.396760 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4a82c8f2-31ee-452e-a68d-933402bfc016 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:41.401898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2c9cdfa1-0efe-4f89-a364-c1e19dba6531 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.195399 Sep 01 18:06:41.405525 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4a82c8f2-31ee-452e-a68d-933402bfc016 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1095 microversion: 2.1 time: 0.071161 Sep 01 18:06:41.406367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 157/296] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:41 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:41.415633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 140/297] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:41 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:41.950070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:41.950787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:41.956772 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:41.957257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:41.957683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:41.958370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:41.958816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:41.959238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:42.024826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:42.032400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ca01c68a-eaec-4048-a4eb-5fce5ba14a72 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1270 microversion: 2.1 time: 0.086176 Sep 01 18:06:42.034166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 158/298] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:41 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:42.424555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:42.425160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:42.432462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:42.432942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:42.433368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:42.434058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:42.434500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:42.434918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:42.437379 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-880b00ff-c9c0-4db9-85f7-4227349dc7ce tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:42.438323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-880b00ff-c9c0-4db9-85f7-4227349dc7ce tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:42.441663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:42.498551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-880b00ff-c9c0-4db9-85f7-4227349dc7ce tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:42.505743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-880b00ff-c9c0-4db9-85f7-4227349dc7ce tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1095 microversion: 2.1 time: 0.074427 Sep 01 18:06:42.506313 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 159/299] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:42 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:42.570018 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:42.580410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a57ab71e-2483-4b30-8c7e-21b3ee4783cd tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.159583 Sep 01 18:06:42.580985 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 141/300] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:42 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:43.053409 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:43.053954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:43.060288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:43.060790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:43.061218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:43.061912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:43.062360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:43.062781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:43.123095 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:43.131314 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8cae02a9-e4f8-4319-848d-b940b966496c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1270 microversion: 2.1 time: 0.081996 Sep 01 18:06:43.131927 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 160/301] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:43 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:43.525429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:43.526031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:43.532552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:43.533025 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:43.533450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:43.534384 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:43.534888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:43.535302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:43.549649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:43.593964 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:43.601101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:43.601680 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d67346e1-2020-41ba-b751-c03cc563f6ed tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1145 microversion: 2.1 time: 0.080091 Sep 01 18:06:43.601905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:43.602254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 142/302] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:43 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:43.607896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:43.608507 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:43.609010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:43.609765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:43.611363 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:43.611363 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:43.735422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:43.743898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-06c1cf78-e775-42e3-80e4-cf445fe1d48d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.146806 Sep 01 18:06:43.744496 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 161/303] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:43 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:44.152122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:44.152756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:44.159023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:44.159506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:44.160584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:44.161385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:44.161841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:44.162269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:44.230707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:44.239383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7aeb22fa-83dc-47fa-87f2-0b88cbf97909 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1270 microversion: 2.1 time: 0.091110 Sep 01 18:06:44.240423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 143/304] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:44 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:44.622901 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:44.623509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:44.630684 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:44.631169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:44.631608 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:44.632295 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:44.632781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:44.633208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:44.695360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:44.702807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ecf05683-f971-4070-aa66-359d88e08cb9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1137 microversion: 2.1 time: 0.083725 Sep 01 18:06:44.703351 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 162/305] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:44 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:44.765048 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:44.765586 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:44.772648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:44.778229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:44.778229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:44.778229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:44.778229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:44.778628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:44.902412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:44.910568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0516bc6c-e96d-4d3e-8e8e-0a6c2d6a3742 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.149360 Sep 01 18:06:44.911159 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 144/306] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:44 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:45.261907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:45.262511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:45.268544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:45.269014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:45.269437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:45.270183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:45.270702 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:45.271114 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:45.331741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:45.339660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-642f1425-fed2-4fdd-b24a-bac8b9977a50 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1270 microversion: 2.1 time: 0.081860 Sep 01 18:06:45.340261 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 163/307] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:45 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:45.724389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:45.725094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:45.728067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:45.731846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:45.732588 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:45.733087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:45.734121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:45.734585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:45.735049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:45.885324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-3827ec17-4353-4a65-8ba7-e00dd8b45c7a req-a6874e43-acb7-4b6a-a828-7dcbd9bbad14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0e643e-dad7-4451-abce-e4481f372f3d", "name": "network-vif-plugged", "status": "completed", "tag": "5eeacdba-549e-4f16-9803-cf2a8f4e4adc"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:45.902541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3827ec17-4353-4a65-8ba7-e00dd8b45c7a req-a6874e43-acb7-4b6a-a828-7dcbd9bbad14 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:45.902835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:45.903712 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3827ec17-4353-4a65-8ba7-e00dd8b45c7a req-a6874e43-acb7-4b6a-a828-7dcbd9bbad14 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:45.905886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3827ec17-4353-4a65-8ba7-e00dd8b45c7a req-a6874e43-acb7-4b6a-a828-7dcbd9bbad14 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:45.918185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ba435e84-5cc6-4ccb-aa92-d22e945d1216 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1193 microversion: 2.1 time: 0.196896 Sep 01 18:06:45.918185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 145/308] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:45 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1193 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:45.923562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-3827ec17-4353-4a65-8ba7-e00dd8b45c7a req-a6874e43-acb7-4b6a-a828-7dcbd9bbad14 service nova] Creating event network-vif-plugged:5eeacdba-549e-4f16-9803-cf2a8f4e4adc for instance 6d0e643e-dad7-4451-abce-e4481f372f3d on hv-cinder-74915 Sep 01 18:06:45.929651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-3827ec17-4353-4a65-8ba7-e00dd8b45c7a req-a6874e43-acb7-4b6a-a828-7dcbd9bbad14 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048061 Sep 01 18:06:45.932530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:45.933142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:45.934660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 164/309] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:06:45.942516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:45.943444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:45.943960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:45.944815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:45.945343 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:45.945850 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:46.096652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:46.106714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d6c5ca64-3374-4719-93a8-ed9a2ac17221 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.179318 Sep 01 18:06:46.108288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 146/310] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:45 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:46.363298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:46.364368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:46.373415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:46.374095 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:46.374522 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:46.375610 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:46.376377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:46.376978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:46.454497 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:46.462454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bf95b067-6a1a-426c-840f-fec8d06d8c71 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1288 microversion: 2.1 time: 0.104548 Sep 01 18:06:46.463024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 165/311] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:46 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:46.947493 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:46.950603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:46.954505 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:46.954979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:46.955410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:46.956083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:46.956721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:46.957148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:47.127814 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:47.128511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:47.134763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:47.135244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:47.135675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:47.136402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:47.136851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:47.137270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:47.294618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:47.296850 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:47.300000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ad48929-4bc5-442c-901f-7e7339ceecf9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.176066 Sep 01 18:06:47.304425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 166/312] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:47 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:47.304774 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6b71d6a3-1df1-4d3f-9517-04dde96f6e01 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1201 microversion: 2.1 time: 0.361433 Sep 01 18:06:47.316674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 147/313] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:46 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1201 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:47.484161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:47.484809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:47.492353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:47.493082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:47.493752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:47.494621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:47.495227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:47.495927 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:47.649240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:47.658837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ba82a978-9d94-4193-bd2f-6ede80d5025b tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.177778 Sep 01 18:06:47.658837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 167/314] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:47 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:48.335719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:48.336249 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:48.337803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:48.338414 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:48.354338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:48.354831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:48.356625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:48.357114 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:48.357914 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:48.358364 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:48.358784 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:48.361427 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:48.361915 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:48.362842 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:48.363927 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:48.372426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:48.445651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:48.454017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-68120f6c-01ef-4e72-a03a-007faa28deee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1211 microversion: 2.1 time: 0.131896 Sep 01 18:06:48.454581 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 168/315] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:48 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:48.684426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:48.684426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:48.686423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:48.686808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:48.687254 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:48.687954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:48.688430 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:48.688860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:48.746416 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:48.754874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c678c663-21d7-43d8-8137-225627386d74 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1372 microversion: 2.1 time: 0.431726 Sep 01 18:06:48.755391 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 148/316] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:48 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1372 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:48.875161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:48.892455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8b96c318-64dc-499c-b790-f27e66ff1f48 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.215240 Sep 01 18:06:48.897951 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 169/317] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:48 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:49.475781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:49.479004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:49.483245 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:49.484094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:49.484736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:49.485444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:49.485901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:49.486326 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:49.551244 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:49.562333 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f29810b6-c76c-4a6b-91d7-a8cdc83a9fc5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1211 microversion: 2.1 time: 0.091091 Sep 01 18:06:49.563264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 149/318] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:49 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:49.602879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-ec0c6740-e77d-4e1d-ab78-1e6b27dba7d9 req-9a62dade-08ab-4c58-b7ea-ccd8202ea3fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6373140-91e1-4789-90f1-1454c4504907", "tag": "a64404e7-a5df-4042-8b13-9ef4b4932bfa"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:49.631249 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ec0c6740-e77d-4e1d-ab78-1e6b27dba7d9 req-9a62dade-08ab-4c58-b7ea-ccd8202ea3fa service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:49.632002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ec0c6740-e77d-4e1d-ab78-1e6b27dba7d9 req-9a62dade-08ab-4c58-b7ea-ccd8202ea3fa service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:49.632729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ec0c6740-e77d-4e1d-ab78-1e6b27dba7d9 req-9a62dade-08ab-4c58-b7ea-ccd8202ea3fa service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:49.660782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-ec0c6740-e77d-4e1d-ab78-1e6b27dba7d9 req-9a62dade-08ab-4c58-b7ea-ccd8202ea3fa service nova] Creating event network-changed:a64404e7-a5df-4042-8b13-9ef4b4932bfa for instance e6373140-91e1-4789-90f1-1454c4504907 on hv-cinder-74915 Sep 01 18:06:49.667710 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-ec0c6740-e77d-4e1d-ab78-1e6b27dba7d9 req-9a62dade-08ab-4c58-b7ea-ccd8202ea3fa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070244 Sep 01 18:06:49.668395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 170/319] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:06:49.779454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:49.780291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:49.789084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:49.790118 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:49.790559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:49.791271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:49.791725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:49.792145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:49.916235 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:49.917118 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:49.923916 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:49.924716 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:49.925588 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:49.926447 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:49.927137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:49.927641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:50.091411 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:50.101114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b50c45ff-de77-4a14-9b10-61c83307b04b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1566 microversion: 2.1 time: 0.328714 Sep 01 18:06:50.114607 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 150/320] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:49 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1566 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:50.124156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:50.124840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:50.125605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:50.135900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:50.137042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:50.137776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:50.137905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b4af35ec-a3c0-414d-adc2-23ab43ea00ce tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.224628 Sep 01 18:06:50.138789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 171/321] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:49 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:50.140856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:50.141526 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:50.142214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:50.266347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-eb8b2edd-91cf-4be8-b179-5607a0af8fca tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146079 Sep 01 18:06:50.266943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 151/322] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:06:50 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:06:50.585281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:50.585886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:50.600905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:50.602534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:50.603056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:50.603886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:50.604659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:50.605137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:50.605557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:50.994029 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:51.002795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4bdaa306-7712-4bb1-ada4-56e6549a622a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.421777 Sep 01 18:06:51.004090 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 172/323] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:50 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:51.160152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:51.165684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:51.167007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:51.167517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:51.167922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:51.168831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:51.169282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:51.169704 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:51.529020 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:51.539163 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bb8240bd-19ee-4905-a379-d0050b35b2ee tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.383830 Sep 01 18:06:51.539783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 152/324] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:51 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:51.837457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-2106c8c1-41b0-4f46-88c9-af89392378b2 req-68a49d3d-2265-4e55-a838-0f1769d5b68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3334a42-c76b-45d7-871a-fe716b049f47", "tag": "60e68c0d-feea-4cb7-86a6-dc2ab48b6f93"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:51.860621 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-62e452f2-18e4-4843-9967-e7925643307b req-4c8e6b3e-2d3a-483d-b8d7-bf99440ac885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0e643e-dad7-4451-abce-e4481f372f3d", "tag": "5eeacdba-549e-4f16-9803-cf2a8f4e4adc"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:51.877342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2106c8c1-41b0-4f46-88c9-af89392378b2 req-68a49d3d-2265-4e55-a838-0f1769d5b68f service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:51.877825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2106c8c1-41b0-4f46-88c9-af89392378b2 req-68a49d3d-2265-4e55-a838-0f1769d5b68f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:51.878919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2106c8c1-41b0-4f46-88c9-af89392378b2 req-68a49d3d-2265-4e55-a838-0f1769d5b68f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:51.882749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-62e452f2-18e4-4843-9967-e7925643307b req-4c8e6b3e-2d3a-483d-b8d7-bf99440ac885 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:51.883464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-62e452f2-18e4-4843-9967-e7925643307b req-4c8e6b3e-2d3a-483d-b8d7-bf99440ac885 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:51.883930 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-62e452f2-18e4-4843-9967-e7925643307b req-4c8e6b3e-2d3a-483d-b8d7-bf99440ac885 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:51.914456 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-62e452f2-18e4-4843-9967-e7925643307b req-4c8e6b3e-2d3a-483d-b8d7-bf99440ac885 service nova] Creating event network-changed:5eeacdba-549e-4f16-9803-cf2a8f4e4adc for instance 6d0e643e-dad7-4451-abce-e4481f372f3d on hv-cinder-74915 Sep 01 18:06:51.914646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-2106c8c1-41b0-4f46-88c9-af89392378b2 req-68a49d3d-2265-4e55-a838-0f1769d5b68f service nova] Creating event network-changed:60e68c0d-feea-4cb7-86a6-dc2ab48b6f93 for instance e3334a42-c76b-45d7-871a-fe716b049f47 on hv-cinder-74915 Sep 01 18:06:51.919077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-62e452f2-18e4-4843-9967-e7925643307b req-4c8e6b3e-2d3a-483d-b8d7-bf99440ac885 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062859 Sep 01 18:06:51.921264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-2106c8c1-41b0-4f46-88c9-af89392378b2 req-68a49d3d-2265-4e55-a838-0f1769d5b68f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102307 Sep 01 18:06:51.922174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 153/325] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:06:51.922836 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 173/326] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:06:52.025149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:52.026246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:52.032527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:52.033126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:52.033939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:52.034945 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:52.035474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:52.035993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:52.201050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:52.212375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-840aa103-cc17-4a1a-8304-f2be8740c8c3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.191065 Sep 01 18:06:52.212931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 154/327] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:52 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:52.565881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:52.567885 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:52.571239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=10 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:52.579299 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:52.580388 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:52.581768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:52.582986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:52.584022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:52.584974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:52.773635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:52.782610 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-87a0f125-ea25-4af9-97d5-4e8020ddb846 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.224664 Sep 01 18:06:52.785032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 174/328] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:52 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:53.235831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:53.236618 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:53.246313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:53.247030 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:53.247674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:53.248751 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:53.249433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:53.250067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:53.386551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:53.397293 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-689a4cf9-4185-48b9-a79c-f042a0971bcb tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.167660 Sep 01 18:06:53.408838 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 155/329] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:53 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:53.805183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:53.805796 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:53.811820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:53.812227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:53.812689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:53.813377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:53.813823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:53.814243 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:53.951807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:53.960068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d446ae9a-3664-4935-b574-589bfdd57c84 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.159784 Sep 01 18:06:53.960795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 175/330] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:53 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:54.425456 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:54.426087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:54.432766 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:54.436024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:54.436024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:54.436024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:54.436024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:54.436416 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:54.653010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:54.665460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-95f8ba35-12bc-4e01-8e0d-c0c251c96677 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.244474 Sep 01 18:06:54.666655 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 156/331] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:54 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:54.981562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:54.982174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:54.989788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:54.990638 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:54.991234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:54.992306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:54.992941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:54.993933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:55.206109 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:55.214941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-30cb4eb5-669c-405f-a940-f852028fc0e5 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.237615 Sep 01 18:06:55.215509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 176/332] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:54 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:55.686894 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:55.687506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:55.713280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:55.715040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:55.715669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:55.716439 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:55.717240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:55.717851 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:55.864572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:55.873336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1aca0751-df36-43b8-9020-1f7a0db9baf5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.190273 Sep 01 18:06:55.876729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 157/333] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:55 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:56.237846 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:56.237846 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:56.246374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:56.246374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:56.246374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:56.247212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:56.247685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:56.248123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:56.266487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:56.405626 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:56.413690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-636029dc-8b18-43b0-8471-8190bee9d1d8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.181482 Sep 01 18:06:56.414258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 177/334] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:56 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:56.897472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:56.898560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:56.904888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:56.905375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:56.906110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:56.906819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:56.907276 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:56.907701 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:57.043219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:57.051031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ac108165-24a7-40fa-a9fa-f11015f82e6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.159776 Sep 01 18:06:57.051815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 158/335] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:56 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:57.435937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:57.436572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:57.460222 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:57.460994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:57.461583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:57.463327 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:57.464460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:57.465036 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:57.614167 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:57.622500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e5406473-7768-4b54-b3c8-f7c9cdcc2c99 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.191068 Sep 01 18:06:57.623730 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 178/336] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:57 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:58.024632 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-234dc201-57f3-429d-9c53-ed39aaacc5ce req-13716ce8-0530-4f93-9e2a-b033e6b0fad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6373140-91e1-4789-90f1-1454c4504907", "name": "network-vif-plugged", "status": "completed", "tag": "a64404e7-a5df-4042-8b13-9ef4b4932bfa"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:06:58.046742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-234dc201-57f3-429d-9c53-ed39aaacc5ce req-13716ce8-0530-4f93-9e2a-b033e6b0fad0 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:58.047344 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-234dc201-57f3-429d-9c53-ed39aaacc5ce req-13716ce8-0530-4f93-9e2a-b033e6b0fad0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:58.047902 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-234dc201-57f3-429d-9c53-ed39aaacc5ce req-13716ce8-0530-4f93-9e2a-b033e6b0fad0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:58.062501 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-234dc201-57f3-429d-9c53-ed39aaacc5ce req-13716ce8-0530-4f93-9e2a-b033e6b0fad0 service nova] Creating event network-vif-plugged:a64404e7-a5df-4042-8b13-9ef4b4932bfa for instance e6373140-91e1-4789-90f1-1454c4504907 on hv-cinder-74915 Sep 01 18:06:58.073343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:58.073854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-234dc201-57f3-429d-9c53-ed39aaacc5ce req-13716ce8-0530-4f93-9e2a-b033e6b0fad0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052649 Sep 01 18:06:58.074391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:58.074937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 159/337] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:06:58.086280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:58.090660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:58.090660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:58.090660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:58.090660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:58.091258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:58.288028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:58.296449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-523ef855-ac18-4391-b316-cf40aaf8c4a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.227611 Sep 01 18:06:58.297166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 179/338] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:58 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:06:58.646477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:58.647260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:58.654166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:58.654722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:58.655371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:58.656199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:58.656700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:58.657192 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:58.811777 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:58.814839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:06:58.829972 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-57d48559-a3e3-4e1b-a2b2-6e92b0fda2b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.184085 Sep 01 18:06:58.832552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 160/339] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:58 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:59.318509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:59.319115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:59.325800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:59.326281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:59.326759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:59.327443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:59.328555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:59.328980 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:59.717147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:06:59.725704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-42cd1212-d1c2-407e-8079-fa27d8624e59 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.411902 Sep 01 18:06:59.726383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 180/340] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:59 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:06:59.860122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:06:59.861308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:06:59.868590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:59.869543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:59.873762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:06:59.873762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:06:59.873762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:06:59.873762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:00.031457 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:00.068389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-34d68870-6783-4690-b1f3-3f80cdc020dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.219532 Sep 01 18:07:00.077437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 161/341] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:06:59 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:00.747018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:00.747618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:00.756013 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:00.756514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:00.766713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:00.766713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:00.766713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:00.766713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:00.956445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:00.964181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e7a7af75-62f4-4bff-96c6-864a6b66d2a5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.220819 Sep 01 18:07:00.964888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 181/342] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:00 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:01.098875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:01.099478 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:01.106057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:01.106539 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:01.107145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:01.110798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:01.110798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:01.110798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:01.264081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:01.274580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3a657802-b82d-445d-b4e3-a922034112f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.178831 Sep 01 18:07:01.274580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 162/343] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:01 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:02.001280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:02.001280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:02.001932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:02.002200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:02.003183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:02.003943 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:02.004421 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:02.004845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:02.157007 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:02.165124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a2f5819d-f95a-4d4c-b53f-a6a66498a7b7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.182952 Sep 01 18:07:02.166142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 182/344] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:01 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:02.294980 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:02.298139 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:02.302907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:02.303458 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:02.303891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:02.304677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:02.305126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:02.305546 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:02.438801 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:02.449299 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8a423c7a-7e0a-4e3f-8b58-9cebfd567d8f tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.157956 Sep 01 18:07:02.449915 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 163/345] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:02 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:07:03.187158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:03.188408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:03.194837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:03.195331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:03.195789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:03.196496 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:03.196952 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:03.197377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:03.381999 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:03.390407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a9d8878b-89e9-481e-a079-efe7c84bc6fa tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.207377 Sep 01 18:07:03.391147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 183/346] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:03 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:03.469949 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:03.470562 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:03.477200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:03.477679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:03.478124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:03.478892 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:03.479304 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:03.479722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:03.701194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:03.709346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6c2d18e9-7c1c-4a5c-bd26-be0498065785 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.243180 Sep 01 18:07:03.709919 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 164/347] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:03 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:04.412167 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:04.413525 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:04.432124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:04.432854 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:04.433442 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:04.434354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:04.434955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:04.435540 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:04.669369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:04.679750 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-091dd249-d147-4875-8b48-3aa37c0ccb78 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.271191 Sep 01 18:07:04.694909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 184/348] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:04 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:04.730584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:04.731565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:04.744205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:04.745314 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:04.745986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:04.746484 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:04.746935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:04.747492 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:04.943784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:04.954194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4a5c56d5-84c9-4c88-aead-0f204bc341c7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.227854 Sep 01 18:07:04.957047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 165/349] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:04 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:05.703181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:05.704391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:05.712428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:05.713058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:05.713504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:05.714402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:05.716526 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:05.717078 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:05.977357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:05.978012 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:05.985149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:05.985652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:05.986070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:05.987283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:05.987737 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:05.988159 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:05.992931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:06.009330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c11a0154-cf8f-4095-ab0a-8220bd501ecc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.302019 Sep 01 18:07:06.009330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 185/350] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:05 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:06.127067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:06.135603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2776d7c4-34e3-43f6-99b2-7df956c07bef tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.162169 Sep 01 18:07:06.136166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 166/351] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:05 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:07.024866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:07.025616 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:07.031876 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:07.032498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:07.032935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:07.034638 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:07.035260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:07.035963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:07.164353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:07.165757 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:07.172671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:07.173460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:07.174001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:07.174905 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:07.175584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:07.176028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:07.189439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:07.198200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2c5f7a9d-e9e8-4c31-9405-16efea418315 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.177145 Sep 01 18:07:07.198799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 186/352] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:07 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:07.336015 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:07.345626 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4026ad5b-9c34-440b-818d-a13850774e64 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.185685 Sep 01 18:07:07.346810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 167/353] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:07 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:08.219769 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:08.220560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:08.228237 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:08.242438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:08.243323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:08.244341 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:08.252232 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:08.252232 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:08.367572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:08.368161 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:08.374163 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:08.374898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:08.375501 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:08.376203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:08.376729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:08.377147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:08.509463 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:08.517639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-486a0158-0ce0-46a8-ad0e-3da62face1c1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.301651 Sep 01 18:07:08.518806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 187/354] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:08 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:08.558444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:08.560627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4f3ff8ce-62aa-4ed6-a239-85383c6c50d0 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.197337 Sep 01 18:07:08.561214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 168/355] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:08 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:07:09.539067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:09.539685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:09.546129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:09.546617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:09.547058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:09.547766 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:09.548219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:09.548727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:09.676556 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a4c791e6-60f9-420e-bae2-6859cad4ee32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Action: 'create', calling method: .version_select at 0x7f446aa7f0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1466158584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbXMb98/fzg/qU1pcIskDtvCU79FKn5GxCm6n2ON+DXFoOG3lUv3hsiCDKuumkoq5U1T4EXBylsQBuxnPAT7eCwwjlcD1nIGjtXdqDYUPSH2hrSZM1HIpVnKqx/7Ep3Dg=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:07:09.697905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a4c791e6-60f9-420e-bae2-6859cad4ee32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Getting quotas for project 0a6caf631e5849f6867042a1f6dcf6aa. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:07:09.703009 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a4c791e6-60f9-420e-bae2-6859cad4ee32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Getting quotas for user 9132e6a676054c93ba33d95d28ded4da and project 0a6caf631e5849f6867042a1f6dcf6aa. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:07:09.725530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:09.733734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6af11ffa-b1db-4599-94d5-6ec33f07718f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.198508 Sep 01 18:07:09.742721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 169/356] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:09 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:07:09.742721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:09.742721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:09.747830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:09.748592 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:09.749027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:09.749729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:09.750183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:09.750608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:09.806161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a4c791e6-60f9-420e-bae2-6859cad4ee32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.332469 Sep 01 18:07:09.812450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 188/357] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:07:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:07:09.893605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:09.902539 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-79f0d633-b144-4b5c-81bb-88b48549fdb2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.167175 Sep 01 18:07:09.903114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 170/358] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:09 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:10.755767 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:10.756546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:10.762999 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:10.763548 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:10.763995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:10.772039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:10.772039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:10.772039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:10.918296 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:10.928586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b773119a-2220-4b0f-b440-9bfb25122337 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.177250 Sep 01 18:07:10.929737 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 189/359] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:10 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:10.942938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:10.943658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:10.955575 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:10.959219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:10.959219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:10.959936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:10.961686 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:10.962120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:11.132217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:11.140167 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9c4168d3-6c50-48a1-92e0-d65e2a2f7d3c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1318 microversion: 2.1 time: 0.220647 Sep 01 18:07:11.140961 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 171/360] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:10 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:07:11.948984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:11.949598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:11.955697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:11.959848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:11.959848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:11.959848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:11.959848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:11.960242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:12.117029 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:12.125033 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-68909bb8-6b64-4618-8fe0-772de4784f5b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.179983 Sep 01 18:07:12.125600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 190/361] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:11 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:12.160905 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:12.161604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:12.167884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:12.168406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:12.168838 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:12.169541 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:12.169989 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:12.170407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:12.552636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:12.564065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e4b9b6cf-2628-4b5c-ae8a-1a8aa473ff23 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1508 microversion: 2.1 time: 0.407323 Sep 01 18:07:12.565057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 172/362] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:12 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1508 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:13.145342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:13.145949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:13.147787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:13.153611 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:13.154320 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:13.154966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:13.155670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:13.156119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:13.156691 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:13.304523 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-952ba124-d4b6-4129-8703-922720a9685b req-99660eda-b219-442e-a2be-12fc59f487ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3334a42-c76b-45d7-871a-fe716b049f47", "name": "network-vif-plugged", "status": "completed", "tag": "60e68c0d-feea-4cb7-86a6-dc2ab48b6f93"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:07:13.316079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:13.318421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-952ba124-d4b6-4129-8703-922720a9685b req-99660eda-b219-442e-a2be-12fc59f487ec service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:13.319247 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-952ba124-d4b6-4129-8703-922720a9685b req-99660eda-b219-442e-a2be-12fc59f487ec service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:13.321004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-952ba124-d4b6-4129-8703-922720a9685b req-99660eda-b219-442e-a2be-12fc59f487ec service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:13.324155 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f8c395e9-41d5-4a50-8b7b-c131697a046f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.182709 Sep 01 18:07:13.324849 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 191/363] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:13 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:13.334394 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-952ba124-d4b6-4129-8703-922720a9685b req-99660eda-b219-442e-a2be-12fc59f487ec service nova] Creating event network-vif-plugged:60e68c0d-feea-4cb7-86a6-dc2ab48b6f93 for instance e3334a42-c76b-45d7-871a-fe716b049f47 on hv-cinder-74915 Sep 01 18:07:13.340136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-952ba124-d4b6-4129-8703-922720a9685b req-99660eda-b219-442e-a2be-12fc59f487ec service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039149 Sep 01 18:07:13.340793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 173/364] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:07:14.345743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:14.346561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:14.353251 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:14.353818 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:14.354344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:14.355164 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:14.355687 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:14.356182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:14.500861 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:14.509919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-51a6c605-0ddd-4198-8562-9c981889be4d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.168711 Sep 01 18:07:14.510604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 192/365] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:14 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:15.553701 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:15.553701 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:15.558238 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:15.558737 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:15.559187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:15.559879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:15.560345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:15.560764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:15.742295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:15.754876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5db748d6-484a-4940-9f5d-bfe418824dc6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1267 microversion: 2.1 time: 0.207497 Sep 01 18:07:15.766250 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 174/366] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:15 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:16.773782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:16.774383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:16.781195 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:16.781690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:16.782264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:16.782987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:16.783722 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:16.784162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:16.966635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:16.972937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-905e056d-a665-4269-8b09-f86237fb4234 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1455 microversion: 2.1 time: 0.203104 Sep 01 18:07:16.973503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 193/367] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:16 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1455 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:07:16.995925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:16.996506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:16.999536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=60 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:17.004330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:17.004833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:17.005263 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:17.006324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:17.006853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:17.007254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:17.155100 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:17.163897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-425bfa9a-8fcb-409f-8453-44a64287670b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1455 microversion: 2.1 time: 0.173306 Sep 01 18:07:17.164419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 175/368] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:16 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:20.013692 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-6402c175-043d-4fdf-9ce7-768cfd3f7f19 req-de6889f6-9b98-4fdf-a344-ce4f8adda6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3334a42-c76b-45d7-871a-fe716b049f47", "tag": "60e68c0d-feea-4cb7-86a6-dc2ab48b6f93"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:07:20.025233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:20.027986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6402c175-043d-4fdf-9ce7-768cfd3f7f19 req-de6889f6-9b98-4fdf-a344-ce4f8adda6e0 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:20.028877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6402c175-043d-4fdf-9ce7-768cfd3f7f19 req-de6889f6-9b98-4fdf-a344-ce4f8adda6e0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:20.032287 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-6402c175-043d-4fdf-9ce7-768cfd3f7f19 req-de6889f6-9b98-4fdf-a344-ce4f8adda6e0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:20.046735 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-6402c175-043d-4fdf-9ce7-768cfd3f7f19 req-de6889f6-9b98-4fdf-a344-ce4f8adda6e0 service nova] Creating event network-changed:60e68c0d-feea-4cb7-86a6-dc2ab48b6f93 for instance e3334a42-c76b-45d7-871a-fe716b049f47 on hv-cinder-74915 Sep 01 18:07:20.053285 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-6402c175-043d-4fdf-9ce7-768cfd3f7f19 req-de6889f6-9b98-4fdf-a344-ce4f8adda6e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043421 Sep 01 18:07:20.065115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 194/369] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:07:44.197084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-331469416", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:07:44.205147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=87 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:44.251479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] validate_networks() for None {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:07:44.531284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:07:44.531772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:07:44.532251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:07:44.532694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:07:44.533117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:07:44.542869 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:44.543342 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:44.543767 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:44.547951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:44.547951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:44.547951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:44.562155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Getting quotas for project bc76188669cb4e6a9549c64de29472ca. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:07:44.566821 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Getting quotas for user 8df40cd433e240f9b6d3f24b971ffdf8 and project bc76188669cb4e6a9549c64de29472ca. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:07:44.577638 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:07:44.580135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:07:44.801588 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b6505491-470a-4771-8eb3-ddf48921a22b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608337 Sep 01 18:07:44.802234 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 176/370] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 18:07:44.813686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6c0e8f46-067a-4ee9-8b86-8aa88c0f1a68 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:44.814390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6c0e8f46-067a-4ee9-8b86-8aa88c0f1a68 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:44.818097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=7 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:44.818729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:44.871914 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6c0e8f46-067a-4ee9-8b86-8aa88c0f1a68 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:44.879492 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6c0e8f46-067a-4ee9-8b86-8aa88c0f1a68 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1214 microversion: 2.1 time: 0.069989 Sep 01 18:07:44.880156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 195/371] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:44 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:45.899792 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6647dd21-353a-4c31-9678-f7b4a71d67c6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:45.900471 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6647dd21-353a-4c31-9678-f7b4a71d67c6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:45.954558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6647dd21-353a-4c31-9678-f7b4a71d67c6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:45.965181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6647dd21-353a-4c31-9678-f7b4a71d67c6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1214 microversion: 2.1 time: 0.069667 Sep 01 18:07:45.966049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 177/372] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:45 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:46.986610 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8c9698e6-46fa-44db-b68d-f7062042cf53 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:46.987159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8c9698e6-46fa-44db-b68d-f7062042cf53 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:47.040962 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8c9698e6-46fa-44db-b68d-f7062042cf53 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:47.048558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8c9698e6-46fa-44db-b68d-f7062042cf53 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1214 microversion: 2.1 time: 0.065658 Sep 01 18:07:47.050787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 196/373] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:46 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:47.944403 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:47.944957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:47.951214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:47.951695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:47.952126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:47.952846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:47.953312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:47.954346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:47.977402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5aa9961e-9886-47c4-8e1f-8b60398ddb9b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/ips" status: 200 len: 153 microversion: 2.20 time: 0.037055 Sep 01 18:07:47.979082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 178/374] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Sep 1 18:07:47 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:07:48.069198 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:48.070506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:48.077773 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:48.078259 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:48.079440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:48.080225 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:48.080708 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:48.081392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:48.149572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:48.158117 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8a552461-412b-43cb-aff6-5f2ce6976a52 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1210 microversion: 2.1 time: 0.092616 Sep 01 18:07:48.158941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 197/375] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:48 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:49.179524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:49.180196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:49.186659 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:49.187138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:49.187576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:49.188267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:49.188741 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:49.189163 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:49.250082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:49.257819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9cf8df3e-561e-45e0-b472-a74a92275432 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1266 microversion: 2.1 time: 0.082166 Sep 01 18:07:49.258389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 179/376] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:49 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:50.278179 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:50.278794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:50.285891 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:50.286528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:50.287285 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:50.288106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:50.288589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:50.289023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:50.355903 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:50.364633 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-300e0263-f531-4b31-b2e6-55827c445d6a tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1284 microversion: 2.1 time: 0.090330 Sep 01 18:07:50.365201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 198/377] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:50 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:51.386382 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:51.386991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:51.394378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:51.394877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:51.395313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:51.396106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:51.396586 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:51.397010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:51.619569 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:51.628174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-150bd553-da9d-4a62-add4-92c60cf2107f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.245726 Sep 01 18:07:51.629175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 180/378] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:51 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:52.536065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-db7f7c5a-ba66-4ffd-9bb4-dce576238873 req-54b038c4-b9ae-4b77-92b7-4358676f1171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b444662d-d9a8-4ee2-a5e9-a927c6ec56f3", "tag": "e98111be-7b64-4dc5-8872-8c8d57b2c197"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:07:52.548266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-db7f7c5a-ba66-4ffd-9bb4-dce576238873 req-54b038c4-b9ae-4b77-92b7-4358676f1171 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:52.549317 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-db7f7c5a-ba66-4ffd-9bb4-dce576238873 req-54b038c4-b9ae-4b77-92b7-4358676f1171 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:52.549747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-db7f7c5a-ba66-4ffd-9bb4-dce576238873 req-54b038c4-b9ae-4b77-92b7-4358676f1171 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:52.561697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-db7f7c5a-ba66-4ffd-9bb4-dce576238873 req-54b038c4-b9ae-4b77-92b7-4358676f1171 service nova] Creating event network-changed:e98111be-7b64-4dc5-8872-8c8d57b2c197 for instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 on hv-cinder-74915 Sep 01 18:07:52.567136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-db7f7c5a-ba66-4ffd-9bb4-dce576238873 req-54b038c4-b9ae-4b77-92b7-4358676f1171 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036930 Sep 01 18:07:52.567960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 199/379] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:07:52.659155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:52.659898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:52.667628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:52.668122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:52.668574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:52.669284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:52.669737 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:52.670173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:52.865289 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:52.873106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-23a9ca2b-86ab-47af-8946-b4240e191dba tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.219021 Sep 01 18:07:52.873711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 181/380] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:52 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:53.145418 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:07:53.146022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:53.152220 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:53.152763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:53.153193 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:53.153896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:53.154350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:53.154780 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:53.181790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lazy-loading 'flavor' on Instance uuid f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:07:53.894952 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:53.895545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:53.901974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:53.902444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:53.902868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:53.903543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:53.903987 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:53.904467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:54.231936 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-99377c43-eaea-404c-9174-b2b1f68d0d3e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/action" status: 202 len: 0 microversion: 2.20 time: 1.091091 Sep 01 18:07:54.236115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 200/381] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 1 18:07:53 2022] POST /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/action => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:07:54.241905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:54.245669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:54.251584 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:54.252049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:54.252768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:54.253646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:54.254103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:54.254710 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:54.275259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:54.284482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2fe180b6-21c7-4d37-987f-64fb9b763f0d tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.394203 Sep 01 18:07:54.285066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 182/382] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:53 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:07:54.394121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:54.403211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:54.404617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:54.405797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b91623b0-e6a9-4236-a349-7228ef3e41a3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.168172 Sep 01 18:07:54.406349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 201/383] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:07:54 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:07:55.307156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:55.307735 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:55.309508 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:55.315093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:55.315572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:55.315997 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:55.316719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:55.317221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:55.317640 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:55.429302 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:55.429921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:55.435895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:55.436401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:55.436834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:55.437521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:55.437996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:55.438443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:55.450651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:55.459853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7967b53c-f653-4bcb-813e-22ebd7d6b125 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.156685 Sep 01 18:07:55.460490 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 183/384] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:55 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:55.575631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:55.584342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:55.585790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:55.586950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ce129ea3-b477-4558-9dbe-203ada2476da tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.161588 Sep 01 18:07:55.587499 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 202/385] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:07:55 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:07:56.481916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:56.482530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:56.484419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=8 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:56.489795 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:56.490271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:56.490697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:56.491421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:56.491869 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:56.492290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:56.610732 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:56.611509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:56.617503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:56.618058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:56.618512 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:56.619185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:56.619637 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:56.620062 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:56.631212 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:56.639260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-82ce9ee1-a076-4e50-be3c-e8b9f9cbe06e tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.161183 Sep 01 18:07:56.639938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 184/386] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:56 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:56.757790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:56.765793 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:56.767926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:56.769105 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bcac5980-b795-46c8-826b-a1ed637609e0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.162529 Sep 01 18:07:56.769655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 203/387] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:07:56 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:07:57.660353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:57.660964 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:57.667336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:57.667815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:57.668236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:57.668942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:57.669384 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:57.669801 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:57.792256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:57.792896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:57.794854 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:07:57.800092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:57.800607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:57.801045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:57.801741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:57.802193 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:57.802621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:57.802828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:57.811077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ab85e084-9378-4f4d-b886-e7d784e16cd7 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.154841 Sep 01 18:07:57.811698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 185/388] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:57 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:07:57.941440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:57.949613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:57.952519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:57.952519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7dd47680-15ea-459b-a866-971530ca7329 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.164047 Sep 01 18:07:57.953059 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 204/389] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:07:57 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:07:58.244802 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c927c27-6854-490e-8451-774e1c5fd924", "device": "/dev/sdb"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:07:58.247948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:58.255063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:58.255552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:58.255978 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:58.257196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:58.257196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:58.257524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:58.833143 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:58.833747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:58.840465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:58.840937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:58.841370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:58.842067 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:58.842519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:58.842940 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:58.977376 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:58.989979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2b78639f-2744-4f69-b794-7ae408599433 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.156752 Sep 01 18:07:58.989979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 205/390] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:07:58 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:07:58.990238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:07:58.990809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:07:58.996436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:58.996972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:58.997419 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:58.998112 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:07:58.998559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:07:58.998980 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:07:59.142511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:59.150551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:59.156213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:07:59.156213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9276ee77-6693-4566-be5b-4721ed808f2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.166592 Sep 01 18:07:59.156213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 206/391] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:07:58 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:07:59.946221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9a55bef4-8671-4c11-ae45-aa38ff1c5b7e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "POST /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.705338 Sep 01 18:07:59.946945 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 186/392] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:07:58 2022] POST /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907/os-volume_attachments => generated 194 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:08:00.011747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:00.012741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:00.019775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:00.020264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:00.020797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:00.021427 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:00.021879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:00.022300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:00.170653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:00.179160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:00.179845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:00.183287 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e2727f3b-44a7-4509-840b-0dea045c1c22 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.181051 Sep 01 18:08:00.183951 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 207/393] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:00 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:00.204736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:00.205132 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1236644019", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1466158584", "security_groups": [{"name": "tempest-secgroup-smoke-1075712158"}], "networks": [{"uuid": "8dbb50f2-cd03-42b8-9cf6-a640e7f9c1da"}], "block_device_mapping_v2": [{"uuid": "a0169cfd-7bc6-4d6f-86c9-b1b1facea898", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:08:00.206201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:00.206809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:00.207746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:00.208395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:00.209000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:00.357808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] validate_networks() for [('8dbb50f2-cd03-42b8-9cf6-a640e7f9c1da', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:08:00.371749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:00.381915 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:00.383345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:00.384617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a569d94b-1d6d-4baf-bf1c-ab43eb9de687 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.210466 Sep 01 18:08:00.385179 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 187/394] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:00 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:00.748068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:08:00.748715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:08:00.749228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:08:00.749635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:08:00.750619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:08:00.761117 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:00.761628 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:00.762067 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:00.762836 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:00.763293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:00.763719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:00.780848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Getting quotas for project 0a6caf631e5849f6867042a1f6dcf6aa. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:08:00.785881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Getting quotas for user 9132e6a676054c93ba33d95d28ded4da and project 0a6caf631e5849f6867042a1f6dcf6aa. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:08:00.845378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:08:00.847625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0169cfd-7bc6-4d6f-86c9-b1b1facea898',volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:08:01.212151 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:01.212775 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:01.219254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:01.219730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:01.220160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:01.220876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:01.221330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:01.221759 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:01.355573 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:01.363470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6bd3ca2e-f76e-4e8a-bd52-d99fb9a18736 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.155191 Sep 01 18:08:01.364041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 188/395] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:01 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:08:01.407462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:01.408090 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:01.414614 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:01.415128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:01.415558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:01.416335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:01.416706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:01.417119 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:01.619205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:01.628822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:01.630419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:01.631680 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a0602ceb-fea3-4629-809e-04b9e80b7c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.228209 Sep 01 18:08:01.632364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 189/396] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:01 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:08:01.689954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-17e974bf-d162-4598-b773-183a55241e04 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.504364 Sep 01 18:08:01.690756 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 208/397] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:08:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:08:01.703527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-712433a4-c5d3-4736-a35e-1b3df3cf6ded tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:01.704376 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-712433a4-c5d3-4736-a35e-1b3df3cf6ded tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:01.797355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-712433a4-c5d3-4736-a35e-1b3df3cf6ded tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:01.821445 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-712433a4-c5d3-4736-a35e-1b3df3cf6ded tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1089 microversion: 2.1 time: 0.108174 Sep 01 18:08:01.821445 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 190/398] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:01 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1089 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:08:01.894553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-37a3b35b-08d0-4a86-9e73-9ff9f316ba26 req-4c3eeaa8-5c5b-40ab-a98c-e2cf0dfa9704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b444662d-d9a8-4ee2-a5e9-a927c6ec56f3", "name": "network-vif-plugged", "status": "completed", "tag": "e98111be-7b64-4dc5-8872-8c8d57b2c197"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:08:01.906399 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37a3b35b-08d0-4a86-9e73-9ff9f316ba26 req-4c3eeaa8-5c5b-40ab-a98c-e2cf0dfa9704 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:01.906879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37a3b35b-08d0-4a86-9e73-9ff9f316ba26 req-4c3eeaa8-5c5b-40ab-a98c-e2cf0dfa9704 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:01.907311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-37a3b35b-08d0-4a86-9e73-9ff9f316ba26 req-4c3eeaa8-5c5b-40ab-a98c-e2cf0dfa9704 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:01.922348 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-37a3b35b-08d0-4a86-9e73-9ff9f316ba26 req-4c3eeaa8-5c5b-40ab-a98c-e2cf0dfa9704 service nova] Creating event network-vif-plugged:e98111be-7b64-4dc5-8872-8c8d57b2c197 for instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 on hv-cinder-74915 Sep 01 18:08:01.927361 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-37a3b35b-08d0-4a86-9e73-9ff9f316ba26 req-4c3eeaa8-5c5b-40ab-a98c-e2cf0dfa9704 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039154 Sep 01 18:08:01.928061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 209/399] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:08:02.384280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:02.384955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:02.391338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:02.391806 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:02.392234 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:02.392938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:02.393409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:02.393823 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:02.527755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:02.537846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-43a52767-d6c4-41a6-8859-88420eb5b7e2 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.157116 Sep 01 18:08:02.538092 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 191/400] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:02 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:02.655627 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:02.656544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:02.663197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:02.663688 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:02.664130 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:02.664860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:02.665315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:02.665741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:02.799860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:02.808124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:02.809596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:02.810746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1954f2a3-c87d-4271-ade1-08ea8ec9a523 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.159444 Sep 01 18:08:02.811311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 210/401] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:02 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:02.828766 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cde47c6e-5cf7-444c-985f-39ecf1fbb610 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:02.829469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cde47c6e-5cf7-444c-985f-39ecf1fbb610 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:02.885393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cde47c6e-5cf7-444c-985f-39ecf1fbb610 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:02.893166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cde47c6e-5cf7-444c-985f-39ecf1fbb610 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1089 microversion: 2.1 time: 0.068885 Sep 01 18:08:02.893748 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 192/402] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:02 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:03.558329 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:03.558955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:03.565541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:03.566026 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:03.566456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:03.567154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:03.567606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:03.568027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:03.703867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:03.711539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8e7e711f-af1f-4466-9f59-fe7f25933e78 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.157243 Sep 01 18:08:03.712091 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 211/403] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:03 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:03.833994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:03.834601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:03.841763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:03.842251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:03.842687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:03.843379 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:03.843832 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:03.844263 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:03.914137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:03.914679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:03.921185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:03.921298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:03.922289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:03.922986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:03.923442 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:03.923866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:03.974728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:03.982997 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:03.985007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:03.985196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:03.986156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-436d6620-030b-4f6c-91af-b6c84e3fdf74 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.156146 Sep 01 18:08:03.986707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 193/404] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:03 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:03.993063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-adf52d8f-8a89-4ab7-a091-7f2f650fa475 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1139 microversion: 2.1 time: 0.082997 Sep 01 18:08:03.993615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 212/405] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:03 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:04.732142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:04.732762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:04.739329 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:04.739808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:04.740230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:04.740955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:04.741403 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:04.741816 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:04.871666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:04.877742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a3eb0c8e-5a81-4762-9f9e-d990e1c9bbd8 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1314 microversion: 2.1 time: 0.149280 Sep 01 18:08:04.878253 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 194/406] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:04 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:08:05.009886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:05.010595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:05.013386 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:05.014001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:05.017077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:05.017552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:05.017984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:05.018699 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:05.019141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:05.019557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:05.019869 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:05.020417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:05.020867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:05.021566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:05.022178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:05.022538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:05.026651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:05.039197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:05.086898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:05.095574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-35748543-c62b-4cc8-8d5b-a095d6200851 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1131 microversion: 2.1 time: 0.086164 Sep 01 18:08:05.096173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 195/407] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:05 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1131 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:08:05.152266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:05.161811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:05.163238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:05.164534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-37df800f-1439-4709-9f35-3c685afd6c9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.158489 Sep 01 18:08:05.165092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 213/408] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:05 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:05.902015 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:05.902620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:05.909930 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:05.910409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:05.910835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:05.911581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:05.912025 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:05.912471 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.039979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:06.047609 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-97e0114c-3a66-466c-b3b7-e52b4021b238 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1464 microversion: 2.1 time: 0.149527 Sep 01 18:08:06.048210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 196/409] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:05 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:06.090978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:06.091477 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:06.101106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.101539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.102228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.103395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.103851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.104283 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.115992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:06.116620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:06.122548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.123025 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.123456 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.124141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.124705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.125566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.131650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:08:06.191628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:06.199341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ca0b829e-1c4f-4e04-8b2a-d069060398a5 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1187 microversion: 2.1 time: 0.087198 Sep 01 18:08:06.199906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 197/410] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:06 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:08:06.204979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:06.205695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:06.211284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.211814 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.212254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.212968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.213517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.213937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.347203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:06.355315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:06.356763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:06.357900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-384d2018-d76a-4057-ae07-0910eb824764 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.157061 Sep 01 18:08:06.358460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 198/411] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:06 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:06.653963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ade6b887-f1b8-45e1-b4d0-f36b774e773b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 204 len: 0 microversion: 2.1 time: 0.566441 Sep 01 18:08:06.654922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 214/412] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:08:06 2022] DELETE /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:08:06.663719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:06.664332 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:06.670402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.672981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.672981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.672981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:06.673497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:06.673857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:06.859725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:06.867667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-82c9bbdb-ffe2-456d-ab3d-0ee13ac975b6 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1470 microversion: 2.1 time: 0.207976 Sep 01 18:08:06.868252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 199/413] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:06 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:07.221233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:07.221939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:07.227878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:07.228407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:07.228848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:07.229555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:07.230000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:07.230420 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:07.296010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:07.304450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c2b134cb-e4cc-417d-a179-6f91f027a36d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1195 microversion: 2.1 time: 0.088009 Sep 01 18:08:07.305012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 215/414] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:07 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:07.381108 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:07.381751 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:07.388331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:07.388848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:07.389281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:07.389999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:07.390472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:07.390888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:07.517992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:07.526050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:07.527530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:07.528708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d3e126c4-03a4-4f64-b588-8dd849e73567 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.151602 Sep 01 18:08:07.529256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 200/415] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:07 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:07.889077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:07.889672 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:07.896278 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:07.900519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:07.900519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:07.900519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:07.900519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:07.900906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:08.040496 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:08.048331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e8bdf208-2809-4834-a408-884123cb6295 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1470 microversion: 2.1 time: 0.163093 Sep 01 18:08:08.048950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 216/416] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:07 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:08.325493 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:08.326093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:08.332651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:08.333127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:08.333555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:08.334231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:08.334677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:08.335093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:08.398011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:08.405613 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-44ea4441-fb8b-4cd4-86f0-cc5fbb5fae6c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1195 microversion: 2.1 time: 0.084006 Sep 01 18:08:08.406980 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 201/417] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:08 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1195 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:08.552629 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:08.553173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:08.559074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:08.559558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:08.559994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:08.560809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:08.561267 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:08.561688 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:08.705282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:08.706899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:08.708360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:08.709524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-73618807-dafd-43b2-b28b-547c3f0badc5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.160953 Sep 01 18:08:08.710070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 217/418] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:08 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:08:09.070229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:09.070955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:09.076818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:09.077291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:09.077759 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:09.078452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:09.078900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:09.079321 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:09.260943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:09.268614 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-54a5b06e-d089-4e28-83f4-5833deff5b9f tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1470 microversion: 2.1 time: 0.203066 Sep 01 18:08:09.269178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 202/419] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:09 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:09.427658 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:09.428258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:09.434321 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:09.434730 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:09.435152 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:09.435822 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:09.436266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:09.436703 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:09.575579 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:09.597068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-66ce198e-df23-4601-a6b5-01b280f2e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1273 microversion: 2.1 time: 0.160405 Sep 01 18:08:09.597068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 218/420] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:09 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:09.731974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:09.745664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:09.745664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:09.745664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:09.745664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:09.746063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:09.746063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:09.746063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:09.872377 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:09.881214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:09.883251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:09.883846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b52cf938-e63a-4bd5-bab5-d479db9e77c4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.155863 Sep 01 18:08:09.884432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 203/421] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:09 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:10.290213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:10.290913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:10.297185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:10.297664 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:10.298196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:10.298994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:10.299436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:10.299855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:10.437334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:10.445946 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-57dcc360-5ba0-4210-ba33-7f42431e498c tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1470 microversion: 2.1 time: 0.159734 Sep 01 18:08:10.446595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 219/422] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:10 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:10.606830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:10.607467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:10.615021 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:10.615524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:10.616133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:10.616910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:10.617361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:10.618207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:10.804334 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:10.811998 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5db903b8-a762-441b-842f-3ac2f9b3e5b2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1273 microversion: 2.1 time: 0.209211 Sep 01 18:08:10.812575 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 204/423] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:10 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:10.907161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:10.908804 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:10.910927 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:10.911589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:10.916281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:10.917427 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:10.917870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:10.918582 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:10.919042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:10.919569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:11.069400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-8edcba9e-66c7-488b-88cd-4040b68712f2 req-7bd02a03-38b7-47de-b3f4-2a652bf65143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b444662d-d9a8-4ee2-a5e9-a927c6ec56f3", "name": "network-vif-deleted", "tag": "e98111be-7b64-4dc5-8872-8c8d57b2c197"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:08:11.090106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-8edcba9e-66c7-488b-88cd-4040b68712f2 req-7bd02a03-38b7-47de-b3f4-2a652bf65143 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:11.092452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-8edcba9e-66c7-488b-88cd-4040b68712f2 req-7bd02a03-38b7-47de-b3f4-2a652bf65143 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:11.093002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-8edcba9e-66c7-488b-88cd-4040b68712f2 req-7bd02a03-38b7-47de-b3f4-2a652bf65143 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:11.118981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-8edcba9e-66c7-488b-88cd-4040b68712f2 req-7bd02a03-38b7-47de-b3f4-2a652bf65143 service nova] Creating event network-vif-deleted:e98111be-7b64-4dc5-8872-8c8d57b2c197 for instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 on hv-cinder-74915 Sep 01 18:08:11.129350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:11.131085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-8edcba9e-66c7-488b-88cd-4040b68712f2 req-7bd02a03-38b7-47de-b3f4-2a652bf65143 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065739 Sep 01 18:08:11.134467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 205/424] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:08:11.153562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:11.155353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:11.156245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f9e72c2c-1017-4b95-bee3-3f258b3ab53c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.253180 Sep 01 18:08:11.156816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 220/425] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:10 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:11.467792 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:11.486034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:11.486034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:11.486034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:11.486034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:11.486571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:11.486571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:11.486571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:11.541602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:11.550521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-62e92e4c-7331-4af3-9fa0-c6ef0b37bd0b tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1299 microversion: 2.1 time: 0.087177 Sep 01 18:08:11.551090 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 206/426] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:11 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:11.833554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:11.834620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:11.843105 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:11.847194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:11.847194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:11.847194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:11.847194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:11.848186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:12.155306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:12.164262 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-97c6a6e3-3280-4016-9f60-c6108239ec1d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1273 microversion: 2.1 time: 0.335173 Sep 01 18:08:12.164855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 221/427] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:11 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:12.183045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:12.183622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:12.191124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:12.191601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:12.192027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:12.192746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:12.193190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:12.193607 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:12.323884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:12.332077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:12.333560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:12.334909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5972fb5b-1baf-47aa-ae47-aa140c150232 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.155861 Sep 01 18:08:12.335460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 207/428] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:12 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:12.570882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:12.571480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:12.577727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:12.578213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:12.578648 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:12.580055 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:12.580572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:12.581027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:12.613083 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:12.613564 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:12.614003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:12.614445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lazy-loading 'fault' on Instance uuid b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:08:12.654316 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8df40cd433e240f9b6d3f24b971ffdf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76188669cb4e6a9549c64de29472ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:12.662897 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-81a1cbd1-e40d-4002-bdbe-5161d6732e55 tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 200 len: 1304 microversion: 2.1 time: 0.095872 Sep 01 18:08:12.663456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 222/429] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:12 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:13.154668 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=4 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:13.168269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-cc7030c5-abf1-4ad0-9c78-a52b53373fbf req-bfa93128-fc0c-40f8-b895-07b8ebaa42a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f510cd-8ecf-4e9d-a60f-97277d17b97c", "tag": "2e2fab45-f892-4f70-bdce-c498f573098d"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:08:13.178314 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cc7030c5-abf1-4ad0-9c78-a52b53373fbf req-bfa93128-fc0c-40f8-b895-07b8ebaa42a8 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:13.178781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cc7030c5-abf1-4ad0-9c78-a52b53373fbf req-bfa93128-fc0c-40f8-b895-07b8ebaa42a8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:13.179388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cc7030c5-abf1-4ad0-9c78-a52b53373fbf req-bfa93128-fc0c-40f8-b895-07b8ebaa42a8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:13.186244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:13.186939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:13.191129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-cc7030c5-abf1-4ad0-9c78-a52b53373fbf req-bfa93128-fc0c-40f8-b895-07b8ebaa42a8 service nova] Creating event network-changed:2e2fab45-f892-4f70-bdce-c498f573098d for instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c on hv-cinder-74915 Sep 01 18:08:13.193080 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:13.193643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:13.194148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:13.194913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:13.195369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:13.195820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:13.196292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-cc7030c5-abf1-4ad0-9c78-a52b53373fbf req-bfa93128-fc0c-40f8-b895-07b8ebaa42a8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042390 Sep 01 18:08:13.196976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 208/430] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:08:13.341463 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:13.349852 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-339231bb-e167-4095-8447-a6eadf2158d9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1273 microversion: 2.1 time: 0.167369 Sep 01 18:08:13.350435 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 223/431] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:13 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:13.359238 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:13.359944 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:13.366962 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:13.367713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:13.368221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:13.368962 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:13.369414 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:13.369843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:13.584617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:13.592623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:13.594075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:13.595482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ed89eaf4-0e60-415e-a5d9-2e8546ebb47f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.240531 Sep 01 18:08:13.596023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 209/432] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:13 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:13.689871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:13.690683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] [instance: b444662d-d9a8-4ee2-a5e9-a927c6ec56f3] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:13.696872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:13.697342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:13.697769 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:13.698443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:13.698885 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:13.699300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:13.713209 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] HTTP exception thrown: Instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 could not be found. Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Request method failure captured: Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 HTTP/1.1 Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPTrZV6EerSc6cp0oeZir-ZFFQtW72x8V8m2FSiiUea0z5E3cCXKpfiTlyb_WhmCrjy-64NxoazU5IP0MRKQ55qI1SuCuW0DzZrvQg6rH88u7qijuujDUFrWeJf51KsSNgMWdMqn3r7AgnMk_bTx9_XuyNsqZXHWRwuAl0w0rck8wTU Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: bc76188669cb4e6a9549c64de29472ca Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesNegativeTest-985375872 Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:08:13.714825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_bc76188669cb4e6a9549c64de29472ca", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc76188669cb4e6a9549c64de29472ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/bc76188669cb4e6a9549c64de29472ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/bc76188669cb4e6a9549c64de29472ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesNegativeTest-985375872 Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: bc76188669cb4e6a9549c64de29472ca Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesNegativeTest-985375872 Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesNegativeTest-985375872-project Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 8df40cd433e240f9b6d3f24b971ffdf8 Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesNegativeTest-985375872-project Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 could not be found. Sep 01 18:08:13.716434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b444662d-d9a8-4ee2-a5e9-a927c6ec56f3'} Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 could not be found. Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:08:13.717306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 could not be found. Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 could not be found. Sep 01 18:08:13.718528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:08:13.719988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] Returning 404 to user: Instance b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:08:13.719988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a000f25d-e24a-471f-86e2-4305b476e4ae tempest-VolumesNegativeTest-985375872 tempest-VolumesNegativeTest-985375872-project] 10.222.0.15 "GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3" status: 404 len: 111 microversion: 2.1 time: 0.031009 Sep 01 18:08:13.719988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 224/433] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:13 2022] GET /compute/v2.1/servers/b444662d-d9a8-4ee2-a5e9-a927c6ec56f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:08:14.370951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:14.385728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:14.385728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:14.385728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:14.385728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:14.385728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:14.386216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:14.386216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:14.386216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:14.514394 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:14.522454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e28f785f-aeb0-4ccd-ba02-40a569c238bf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.155810 Sep 01 18:08:14.523011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 210/434] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:14 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:14.619553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:14.620172 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:14.626805 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:14.632019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:14.632019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:14.632019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:14.632019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:14.632407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:14.769508 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:14.777562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:14.778985 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:14.780121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0ea6fcc4-82ab-4f67-ac42-bc30f4a22f6c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.164941 Sep 01 18:08:14.780688 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 225/435] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:14 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:15.545022 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:15.545795 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:15.553625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:15.554135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:15.554559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:15.555244 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:15.555685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:15.556098 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:15.687990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:15.695805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ef3dd7e7-52f9-45ab-b43c-8b33f89bee3f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.154707 Sep 01 18:08:15.698575 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 211/436] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:15 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:15.803419 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:15.809340 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:15.809921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:15.810425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:15.810872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:15.811563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:15.812004 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:15.812449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:15.943131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:15.951157 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:15.952635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:15.953903 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-71ede5eb-9156-47b6-ba93-562fab77ebb0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.154306 Sep 01 18:08:15.954456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 226/437] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:15 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:16.716404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:16.717009 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:16.723987 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:16.724506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:16.724932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:16.725982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:16.726419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:16.726842 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:16.877154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:16.885563 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f9491c8c-8c45-4d9b-b956-d499e3328e32 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.173100 Sep 01 18:08:16.886133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 212/438] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:16 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:16.976623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:16.977233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:16.983452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:16.983935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:16.984390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:16.985141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:16.986253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:16.986678 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:17.149045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:17.158159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:17.159930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:17.161139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-75283c8c-f412-4b8f-b4ec-6d72142dc069 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.188503 Sep 01 18:08:17.161678 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 227/439] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:16 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:17.907055 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:17.908914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:17.915311 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:17.915831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:17.916270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:17.916987 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:17.917443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:17.917871 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:17.921862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:18.057192 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:18.065389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a18362e5-7c01-4750-a6cb-b445806338f6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.162157 Sep 01 18:08:18.065993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 213/440] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:17 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:18.185411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:18.186000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:18.188027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:18.193607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:18.202950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:18.202950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:18.202950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:18.202950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:18.203411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:18.346825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:18.349500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:18.354791 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:18.356579 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:18.357751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e6c6e71d-3c85-4ecf-aba9-2c921a137953 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.176747 Sep 01 18:08:18.358291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 228/441] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:18 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:19.086303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:19.086867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:19.093188 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:19.093659 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:19.094087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:19.094805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:19.095261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:19.095667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:19.227202 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:19.234872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d04ec5af-3c7b-4522-9340-0b9712377bc7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.152531 Sep 01 18:08:19.236337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 214/442] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:19 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:19.381236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:19.381838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:19.392048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:19.392048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:19.392048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:19.392048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:19.392460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:19.392460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:19.524536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:19.531700 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:19.534499 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:19.535653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6c14952c-932d-4167-9cb5-f09079080bc7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.159112 Sep 01 18:08:19.536258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 229/443] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:19 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:20.259334 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:20.260147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:20.268194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:20.268699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:20.269136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:20.269866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:20.270614 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:20.270826 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:20.494385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:20.502654 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-473ee97e-a914-40e6-b939-69cd3c731167 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.249000 Sep 01 18:08:20.503232 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 215/444] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:20 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:20.559585 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:20.560577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:20.568551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:20.569533 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:20.570336 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:20.572786 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:20.573514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:20.574363 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:20.741044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:20.749345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:20.751325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:20.752521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d543e28f-89ba-4cad-b42b-84704d416ddc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.197768 Sep 01 18:08:20.753070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 230/445] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:20 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:21.523292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:21.523840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:21.530601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:21.531080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:21.531545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:21.532808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:21.533331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:21.534084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:21.683127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:21.691860 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-aa06ae26-3898-4d75-a9f0-7ac72a485d87 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.172743 Sep 01 18:08:21.692452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 216/446] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:21 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:21.778110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:21.778622 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:21.785706 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:21.786182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:21.786615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:21.787303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:21.787752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:21.788170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:21.928730 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:21.936842 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:21.938808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:21.940123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-34d6bc09-ac83-4bac-bdb0-f8fbac91b576 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.166562 Sep 01 18:08:21.940706 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 231/447] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:21 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:22.712114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:22.712821 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:22.719337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:22.720572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:22.721044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:22.721745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:22.722200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:22.722627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:22.859251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:22.867103 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9024f606-2beb-45f8-a1a7-818764d67224 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.158803 Sep 01 18:08:22.867671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 217/448] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:22 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:22.963395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:22.964072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:22.971452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:22.974356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:22.974356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:22.974356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:22.974356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:22.974752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:23.111983 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:23.118367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:23.119816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:23.121010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5fc2e96a-83c4-415f-b714-7af63325b1c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.161662 Sep 01 18:08:23.121576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 232/449] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:22 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:23.887976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:23.888605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:23.895590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:23.896166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:23.896627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:23.897323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:23.897773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:23.898197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:24.034232 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:24.042179 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e20ee832-bf82-4249-a919-4099a5111bcd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.158032 Sep 01 18:08:24.042746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 218/450] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:23 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:24.143961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:24.144603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:24.150503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:24.150983 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:24.151414 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:24.152099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:24.152572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:24.152998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:24.280693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:24.289993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:24.291443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:24.292621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c0228847-feb3-4052-9084-558cc3f930ae tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.152586 Sep 01 18:08:24.293178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 233/451] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:24 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:25.063685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:25.064483 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:25.070886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:25.071464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:25.071802 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:25.072534 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:25.072991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:25.073419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:25.203337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:25.211575 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b5d473e3-47ec-48d5-8eee-a83d65923be8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.152175 Sep 01 18:08:25.212117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 219/452] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:25 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:25.318960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:25.319510 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:25.326345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:25.326945 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:25.327502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:25.328390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:25.329559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:25.330050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:25.462906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:25.472274 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:25.473917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:25.475247 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-40d9a827-5e8a-41e3-8d86-cd6d85d19a2a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.162660 Sep 01 18:08:25.475804 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 234/453] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:25 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:26.231841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:26.232474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:26.239569 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:26.240049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:26.240506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:26.241204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:26.241650 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:26.242069 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:26.379863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:26.387488 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-02c1cae2-7d59-48c2-ad63-77a2e6663936 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.159512 Sep 01 18:08:26.388048 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 220/454] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:26 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:26.502537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:26.503135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:26.509117 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:26.509595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:26.510025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:26.510708 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:26.511158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:26.511578 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:26.639789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:26.648160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:26.649628 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:26.650782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-78a61486-dc32-4c7b-97f8-22667467e75d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.152834 Sep 01 18:08:26.651332 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 235/455] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:26 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:27.408088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:27.408912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:27.415147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:27.415634 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:27.416071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:27.416791 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:27.417251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:27.419355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:27.549756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:27.557560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0e3624c0-f9c3-4d7e-b9e4-dd190f61bc31 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.154279 Sep 01 18:08:27.558116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 221/456] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:27 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:27.674304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:27.674857 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:27.680841 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:27.681321 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:27.681752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:27.682431 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:27.682881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:27.683301 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:27.809558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:27.817769 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:27.819206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:27.820375 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-546441dd-9594-40f5-91a1-3339015a4e2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.150382 Sep 01 18:08:27.820931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 236/457] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:27 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:28.578161 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:28.578865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:28.585128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:28.585595 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:28.586018 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:28.586695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:28.587137 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:28.587549 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:28.718035 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:28.725926 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-31039b76-b31e-46ac-b924-72c057d075a8 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.151529 Sep 01 18:08:28.726482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 222/458] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:28 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:28.843055 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:28.843592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:28.850107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:28.855395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:28.855395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:28.855395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:28.855395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:28.855803 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:28.980134 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:28.988958 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:28.990400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:28.991540 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b074115-cfc1-4942-9aa2-91e089b68fe9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.152473 Sep 01 18:08:28.992085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 237/459] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:28 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:29.746860 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:29.747486 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:29.754470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:29.754940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:29.755361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:29.756038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:29.756506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:29.756922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:29.901075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:29.909177 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-17ae4f67-65b9-41ce-94b2-2d2a9ca895d3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.166001 Sep 01 18:08:29.909782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 223/460] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:29 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:30.014621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:30.015249 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:30.021367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:30.021840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:30.022271 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:30.022951 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:30.023400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:30.023823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:30.149439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:30.157470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:30.159200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:30.160371 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-00315a9d-a39d-4e56-a5bd-780aa4cb708d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.149809 Sep 01 18:08:30.160922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 238/461] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:30 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:30.930462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:30.931065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:30.937495 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:30.937967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:30.938393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:30.939071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:30.939515 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:30.939931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:31.066980 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:31.074564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-093641b4-5408-4654-9612-4a5b4145965f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.147964 Sep 01 18:08:31.075120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 224/462] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:30 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:31.183397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:31.183975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:31.190273 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:31.190753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:31.191187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:31.191870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:31.192337 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:31.192761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:31.321858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:31.330603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:31.347346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:31.347346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5f50b86f-e2bb-4d76-9aac-8ecdd4613881 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.153821 Sep 01 18:08:31.347346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 239/463] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:31 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:32.097291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:32.097897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:32.104357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:32.104829 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:32.105256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:32.105930 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:32.106375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:32.106792 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:32.241121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:32.248824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-38827cfe-c57c-432e-946b-913ff29bee91 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.156130 Sep 01 18:08:32.249389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 225/464] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:32 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:32.355695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:32.356214 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:32.363098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:32.363584 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:32.364010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:32.364733 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:32.365185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:32.365605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:32.501717 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:32.509819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:32.511253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:32.512515 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-82ffc297-a6f9-4f5a-88d3-80d389fe1518 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.160621 Sep 01 18:08:32.513075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 240/465] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:32 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:33.270652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:33.271249 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:33.277604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:33.278072 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:33.280599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:33.280599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:33.280599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:33.280599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:33.408541 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:33.416934 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e164f113-946a-4c3c-93cc-9131a787aa3e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.150223 Sep 01 18:08:33.417241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 226/466] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:33 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:33.535419 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:33.536052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:33.541996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:33.542483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:33.542915 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:33.543597 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:33.544045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:33.544606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:33.670308 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:33.678912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:33.680409 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:33.681488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-892f2503-672d-4e97-b536-58659d216a2b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.150475 Sep 01 18:08:33.682040 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 241/467] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:33 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:34.437448 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:34.438206 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:34.451011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:34.451865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:34.452647 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:34.454456 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:34.455140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:34.455561 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:34.601679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:34.609312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-19333900-0022-4797-a24b-c3caca7464b6 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.175761 Sep 01 18:08:34.610041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 227/468] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:34 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:34.705697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:34.706810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:34.712866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:34.713344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:34.713774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:34.714456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:34.714924 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:34.715338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:35.057635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:35.064741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:35.066179 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:35.067349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b7395a5e-3149-4ee1-b824-b4bfdd50d7c1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.366585 Sep 01 18:08:35.067905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 242/469] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:34 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:35.630731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:35.631331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:35.637722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:35.638198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:35.638622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:35.639300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:35.639741 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:35.640158 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:35.769459 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:35.777196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-90bddbcf-fdda-4549-a99b-954ede74c489 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.150403 Sep 01 18:08:35.777695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 228/470] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:35 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:36.089987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:36.090597 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:36.097350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:36.097839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:36.098277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:36.098965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:36.099414 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:36.099836 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:36.225756 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:36.233712 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:36.235812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:36.237002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-66d51507-dbb6-4345-acf5-3a719c297bfb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.150867 Sep 01 18:08:36.237551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 243/471] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:36 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:36.809243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:36.809875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:36.816282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:36.816887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:36.826297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:36.826297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:36.826297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:36.826297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:36.949085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:36.952450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:36.963519 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ab9f0120-d566-4d57-bb16-54f3cbec0866 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.152145 Sep 01 18:08:36.963519 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 229/472] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:36 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:37.260023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:37.260655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:37.267520 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:37.267994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:37.268454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:37.269138 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:37.269609 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:37.270025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:37.397489 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:37.417615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:37.417615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:37.417615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5ff67e70-275d-49a4-b2db-ceba36043a63 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.152743 Sep 01 18:08:37.417912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 244/473] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:37 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:37.979080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:37.979685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:37.987587 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:37.988061 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:37.988553 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:37.989237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:37.989687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:37.990133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:38.121462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:38.129058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-23628a52-6aa4-41b7-a89a-e72e22fab86d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.153898 Sep 01 18:08:38.129615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 230/474] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:37 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:38.432460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:38.433052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:38.439768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:38.440240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:38.440696 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:38.441397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:38.441847 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:38.442260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:38.460330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:38.575334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:38.583593 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:38.585063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:38.586209 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1e63cc65-6b1d-4508-bf4b-992a6cb17d2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.157700 Sep 01 18:08:38.586754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 245/475] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:38 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:39.150101 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:39.150706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:39.157722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:39.158298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:39.167325 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:39.168082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:39.169160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:39.169160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:39.314578 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:39.322392 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a19f5438-8630-4c62-afab-49a694cbbc5f tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.176168 Sep 01 18:08:39.323216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 231/476] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:39 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:39.397061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-eebfd3be-16ba-4932-956b-94f4362c88a6 req-52e3ff7a-d6f0-4da9-8026-197b45a630b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47", "name": "network-vif-plugged", "status": "completed", "tag": "2f84538c-e0cf-462c-ba99-07996763dee1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:08:39.407028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-eebfd3be-16ba-4932-956b-94f4362c88a6 req-52e3ff7a-d6f0-4da9-8026-197b45a630b2 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:39.408544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-eebfd3be-16ba-4932-956b-94f4362c88a6 req-52e3ff7a-d6f0-4da9-8026-197b45a630b2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:39.408544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-eebfd3be-16ba-4932-956b-94f4362c88a6 req-52e3ff7a-d6f0-4da9-8026-197b45a630b2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:39.420695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-eebfd3be-16ba-4932-956b-94f4362c88a6 req-52e3ff7a-d6f0-4da9-8026-197b45a630b2 service nova] Creating event network-vif-plugged:2f84538c-e0cf-462c-ba99-07996763dee1 for instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 on hv-cinder-74915 Sep 01 18:08:39.426779 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-eebfd3be-16ba-4932-956b-94f4362c88a6 req-52e3ff7a-d6f0-4da9-8026-197b45a630b2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033485 Sep 01 18:08:39.427408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 246/477] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:08:39.610168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:39.611064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:39.617288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:39.617841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:39.618286 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:39.619008 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:39.619451 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:39.619867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:39.755916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:39.764037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:39.765558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:39.766813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-05a95b85-9e15-47b8-8909-59050bf202e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.161429 Sep 01 18:08:39.767364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 232/478] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:39 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:40.343481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:40.344986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:40.351170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:40.351646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:40.352072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:40.352783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:40.353235 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:40.353661 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:40.495185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:40.504028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a3cc37c1-52a5-4466-95a1-48eac22d8000 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.165079 Sep 01 18:08:40.504635 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 247/479] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:40 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:40.795069 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:40.795720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:40.802785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:40.803260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:40.803687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:40.804397 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:40.804844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:40.805257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:40.937119 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:40.945916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:40.946714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:40.947861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3d95f8e1-8db2-477a-9b20-8b231421214f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.156785 Sep 01 18:08:40.948436 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 233/480] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:40 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:41.524673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:41.525338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:41.531262 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:41.531744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:41.532173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:41.532889 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:41.533335 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:41.534010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:41.668020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:41.676119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a04ad33e-f3dd-41e9-8919-9fbbb34fa628 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.155371 Sep 01 18:08:41.676719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 248/481] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:41 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:41.970409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:41.971002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:41.977514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:41.978005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:41.978438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:41.979121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:41.979572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:41.979989 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:42.051142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-e0a2bd45-8eac-4d55-b2e1-72672157cbf9 req-284b0c1f-aa54-4bb7-ab54-729612263c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f510cd-8ecf-4e9d-a60f-97277d17b97c", "name": "network-vif-plugged", "status": "completed", "tag": "2e2fab45-f892-4f70-bdce-c498f573098d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:08:42.061672 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e0a2bd45-8eac-4d55-b2e1-72672157cbf9 req-284b0c1f-aa54-4bb7-ab54-729612263c1b service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:42.062150 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e0a2bd45-8eac-4d55-b2e1-72672157cbf9 req-284b0c1f-aa54-4bb7-ab54-729612263c1b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:42.062594 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e0a2bd45-8eac-4d55-b2e1-72672157cbf9 req-284b0c1f-aa54-4bb7-ab54-729612263c1b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:42.074823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-e0a2bd45-8eac-4d55-b2e1-72672157cbf9 req-284b0c1f-aa54-4bb7-ab54-729612263c1b service nova] Creating event network-vif-plugged:2e2fab45-f892-4f70-bdce-c498f573098d for instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c on hv-cinder-74915 Sep 01 18:08:42.079962 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-e0a2bd45-8eac-4d55-b2e1-72672157cbf9 req-284b0c1f-aa54-4bb7-ab54-729612263c1b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034064 Sep 01 18:08:42.080714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 249/482] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:08:42.113000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:42.121513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:42.122969 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:42.127804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-004babcb-2801-4bce-9683-57aa58e8a4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.157860 Sep 01 18:08:42.127804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 234/483] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:41 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:42.697659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:42.698348 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:42.705245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:42.705811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:42.706251 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:42.706960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:42.707414 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:42.707840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:42.839215 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:42.847226 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-10d837a5-0f3b-425e-b1e6-60d50564f261 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.153859 Sep 01 18:08:42.848032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 250/484] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:42 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:43.147149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:43.152740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:43.154298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:43.154778 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:43.155211 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:43.155895 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:43.156370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:43.157359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:43.288572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:43.296596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:43.298728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:43.299966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f1739c54-2bc1-4be7-8265-e2d9973a2898 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.156698 Sep 01 18:08:43.300545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 235/485] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:43 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:43.869898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:43.870500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:43.877074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:43.891824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:43.891824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:43.891824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:43.891824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:43.892188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:44.011282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:44.019710 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c2333805-7e4d-4179-953b-7a2b2a01b8dc tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.153659 Sep 01 18:08:44.020273 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 251/486] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:43 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:44.322145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:44.322752 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:44.329446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:44.329940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:44.330376 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:44.331075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:44.331524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:44.331942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:44.466569 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:44.474902 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:44.476411 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:44.477568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c784949b-cfc4-42f6-8b9b-9149f8d337a7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.159363 Sep 01 18:08:44.478152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 236/487] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:44 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:45.040350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:45.040896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:45.046808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:45.047328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:45.047990 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:45.048701 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:45.049149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:45.049566 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:45.176397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:45.183960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9588c294-174d-4335-8c49-c789547eefdd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.147617 Sep 01 18:08:45.184543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 252/488] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:45 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:08:45.501397 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:45.502002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:45.508467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:45.508948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:45.509377 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:45.510207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:45.510656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:45.511075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:45.637984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:45.646029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:45.647461 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:45.648633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-23fbbe3a-7210-4a26-b437-a6d72599222a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.151721 Sep 01 18:08:45.649183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 237/489] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:45 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:46.204586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:46.205194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:46.211177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:46.211647 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:46.212096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:46.212793 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:46.213243 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:46.213663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:46.351282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:46.358935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-17fddd63-4210-4760-b4dc-81f15b224f55 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.158336 Sep 01 18:08:46.359500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 253/490] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:46 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:46.671261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:46.671866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:46.674672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=56 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:46.679318 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:46.679832 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:46.680270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:46.680986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:46.681438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:46.681864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:46.812055 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:46.820931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:46.822380 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:46.823531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e39ddaa2-c38f-4260-82fb-a19d09374c77 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.156183 Sep 01 18:08:46.824079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 238/491] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:46 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:47.380543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:47.381145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:47.387123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:47.387603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:47.388030 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:47.388740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:47.389186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:47.389602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:47.517508 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:47.525148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a0d7e6f2-2d26-4062-baff-0a3ea4ff86b4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.148681 Sep 01 18:08:47.525703 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 254/492] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:47 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:47.847117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:47.847647 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:47.854003 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:47.854472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:47.854897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:47.855571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:47.856012 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:47.856572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:48.139506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:48.148002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:48.149480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:48.150630 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ff71a48c-60f0-4e53-93ee-1a8933bcd619 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.308033 Sep 01 18:08:48.151184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 239/493] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:47 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:48.546099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:48.546704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:48.552862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:48.553342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:48.553771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:48.554454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:48.554900 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:48.555319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:48.683211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:48.691400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-377de28a-bace-49fd-bf35-108fa599ce00 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.149123 Sep 01 18:08:48.691982 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 255/494] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:48 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:49.174553 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:49.175258 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:49.182073 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:49.182542 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:49.182964 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:49.183645 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:49.184086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:49.184531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:49.314016 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:49.321974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:49.323429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:49.324604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-48c98927-458e-4dec-862d-e7f02a38c015 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.154606 Sep 01 18:08:49.325146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 240/495] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:49 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:49.712116 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:49.712785 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:49.714779 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=56 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:49.720090 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:49.720624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:49.721057 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:49.721739 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:49.722188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:49.722609 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:49.913276 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:49.924131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-014267c2-bf84-420a-8987-b289f818c00c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.215257 Sep 01 18:08:49.924725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 256/496] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:49 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:50.347603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:50.348115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:50.354576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:50.355052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:50.355486 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:50.356177 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:50.356660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:50.357084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:50.492821 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:50.506687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:50.508001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:50.509290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5ed57ef2-edc3-496e-83dd-fe8ed896b9bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.166254 Sep 01 18:08:50.509833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 241/497] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:50 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:50.945302 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:50.945900 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:50.951831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:50.952333 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:50.952768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:50.953709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:50.954315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:50.954737 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:51.081834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:51.090110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9c75ea9d-6f0d-49a5-8ef9-8cfb036ab9ad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.148564 Sep 01 18:08:51.090758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 257/498] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:50 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:51.535984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:51.536623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:51.542540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:51.543014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:51.543441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:51.544115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:51.544587 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:51.545011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:51.673724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:51.681687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:51.683179 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:51.684341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-815bdb73-da6f-4768-ae7e-e6c915181c21 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.153395 Sep 01 18:08:51.684895 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 242/499] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:51 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:52.110315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:52.110931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:52.116912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:52.117392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:52.117816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:52.118488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:52.118934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:52.119345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:52.254487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:52.262388 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d2e1f441-6bc3-4776-ae3a-9788e58f814e tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.156567 Sep 01 18:08:52.262957 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 258/500] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:52 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:52.707259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:52.707844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:52.714406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:52.714884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:52.715315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:52.715999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:52.716475 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:52.716890 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:52.850881 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:52.858962 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:52.861062 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:52.862250 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9aec5c58-4d79-4eac-8463-68872d8758c0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.159537 Sep 01 18:08:52.862808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 243/501] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:52 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:53.284084 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:53.284779 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:53.291220 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:53.291763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:53.292185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:53.292913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:53.293447 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:53.293875 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:53.443311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:53.451131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ee4b62df-49e6-4f06-bdb1-c5569c6dc0a2 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1261 microversion: 2.1 time: 0.172045 Sep 01 18:08:53.451699 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 259/502] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:53 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:53.884846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:53.888855 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:53.892085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:53.892615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:53.893034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:53.893721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:53.894171 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:53.894594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:54.029241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:54.038008 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:54.039434 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:54.040613 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8ad4b014-b924-494e-a798-c2211048fbc8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1744 microversion: 2.20 time: 0.159678 Sep 01 18:08:54.041175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 244/503] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:53 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:54.472835 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:54.473437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:54.479454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:54.479927 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:54.480374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:54.481053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:54.481511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:54.481923 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:54.619176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:54.629885 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-821a7a54-f534-4e8d-a640-249d111b6c79 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1445 microversion: 2.1 time: 0.161361 Sep 01 18:08:54.630614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 260/504] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:54 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:54.658234 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:54.659236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:54.666185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:54.667347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:54.667826 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:54.668919 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:54.669533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:54.670143 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:54.850200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:54.857331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:54.858207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:54.863022 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d14bdf56-027b-4b28-9a6b-a85ac7718ed9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1445 microversion: 2.1 time: 0.209158 Sep 01 18:08:54.863602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 245/505] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:54 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1445 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:08:54.876571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:54.876571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:54.876571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:54.876571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:54.877095 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:54.877095 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:55.011837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lazy-loading 'services' on Instance uuid e6373140-91e1-4789-90f1-1454c4504907 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:08:55.063714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:55.065249 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:55.071671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:55.072144 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:55.072596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:55.073321 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:55.073939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:55.074357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:55.092682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:55.305402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:55.324223 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:55.326033 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:55.327357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b8f847ee-f9cb-488a-ad43-ac08b05a97b1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.267740 Sep 01 18:08:55.328149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 246/506] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:55 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:08:55.382142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-741459d1-b8b7-4e4e-b5a3-db8ddb299250 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907/os-volume_attachments/2c927c27-6854-490e-8451-774e1c5fd924" status: 202 len: 0 microversion: 2.1 time: 0.528671 Sep 01 18:08:55.388882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 261/507] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:08:54 2022] DELETE /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907/os-volume_attachments/2c927c27-6854-490e-8451-774e1c5fd924 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 18:08:56.352661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:56.353385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:56.363658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:56.364551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:56.365236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:56.366250 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:56.367713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:56.368323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:56.703250 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:56.728437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:56.728437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:56.741684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6dc27a01-3b96-44c9-82a4-22736fc0ebd7 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.382133 Sep 01 18:08:56.742986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 247/508] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:56 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:57.641749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:57.642433 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:57.653266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:57.654245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:57.654884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:57.661005 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:57.667979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:57.668730 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:57.708881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:08:57.720671 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:08:57.777948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:57.777948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:57.785589 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:57.786662 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:57.788973 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:57.790001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:57.791913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:57.792630 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:58.293830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:58.304147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:58.306729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:58.308863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-43fee1ef-d1e5-4311-a259-1cb1ed28936b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.544190 Sep 01 18:08:58.308863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 248/509] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:57 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:58.358928 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f087ed6a-af1a-45ed-89a5-99e2782a94b2 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 204 len: 0 microversion: 2.1 time: 0.723143 Sep 01 18:08:58.361713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 262/510] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:08:57 2022] DELETE /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:08:58.371651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:58.372443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:58.382068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:58.382068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:58.382461 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:58.383284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:58.383744 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:58.384178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:58.708742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:58.708742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b2319d1c-6db3-4c22-ac16-f20e33f33fec tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1514 microversion: 2.1 time: 0.290150 Sep 01 18:08:58.708742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 249/511] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:58 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:08:59.219230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-ce861122-6a26-482a-a6ce-1121e208cc30 req-7ad0e127-ba66-40eb-8299-a612e77b44d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f510cd-8ecf-4e9d-a60f-97277d17b97c", "tag": "2e2fab45-f892-4f70-bdce-c498f573098d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:08:59.228690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ce861122-6a26-482a-a6ce-1121e208cc30 req-7ad0e127-ba66-40eb-8299-a612e77b44d4 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:59.229182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ce861122-6a26-482a-a6ce-1121e208cc30 req-7ad0e127-ba66-40eb-8299-a612e77b44d4 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:59.229576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ce861122-6a26-482a-a6ce-1121e208cc30 req-7ad0e127-ba66-40eb-8299-a612e77b44d4 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:59.240669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-ce861122-6a26-482a-a6ce-1121e208cc30 req-7ad0e127-ba66-40eb-8299-a612e77b44d4 service nova] Creating event network-changed:2e2fab45-f892-4f70-bdce-c498f573098d for instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c on hv-cinder-74915 Sep 01 18:08:59.246424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-ce861122-6a26-482a-a6ce-1121e208cc30 req-7ad0e127-ba66-40eb-8299-a612e77b44d4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Sep 01 18:08:59.246759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 263/512] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:08:59.331482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:59.332080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:59.338510 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:59.338994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:59.339426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:59.340121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:59.340639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:59.341080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:59.505551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:59.516103 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:59.518682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:59.521024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-80ed784d-f04a-48da-a696-bcfa2f5f41ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.193775 Sep 01 18:08:59.532347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 250/513] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:08:59 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:08:59.682543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:08:59.683557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:08:59.692028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:59.692978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:59.693800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:59.694737 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:08:59.695424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:08:59.696085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:08:59.880879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:08:59.895458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f02cc265-7b55-45fb-b178-ef849ddc534c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1514 microversion: 2.1 time: 0.218853 Sep 01 18:08:59.926415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 264/514] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:08:59 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:09:00.550582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:00.552219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:00.558106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:00.558882 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:00.559687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:00.560667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:00.561457 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:00.562134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:00.711322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:00.723353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:00.725169 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:00.726348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-661297d0-0c79-4e50-9b12-2fe3cfff60d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.180832 Sep 01 18:09:00.726903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 251/515] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:00 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:00.930440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:00.931146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:00.937242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:00.937964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:00.938607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:00.939466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:00.940001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:00.940521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:01.094399 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:01.102587 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-392cddac-0f97-4e43-b612-f85a729b03c9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1514 microversion: 2.1 time: 0.176150 Sep 01 18:09:01.104024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 265/516] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:00 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:02.046027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:02.046886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:02.054010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:02.054868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:02.055521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:02.056519 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:02.057198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:02.058028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:02.125373 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:02.126133 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:02.131956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:02.132465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:02.132898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:02.133572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:02.134015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:02.134429 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:02.205536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:02.214193 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:02.215658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:02.216867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6c362245-3b04-4942-9d29-eaf825a34833 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.469584 Sep 01 18:09:02.217425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 252/517] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:01 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:02.299959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:02.299959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-556163c1-a740-4a8a-8564-b5d14a01db66 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1514 microversion: 2.1 time: 0.171681 Sep 01 18:09:02.299959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 266/518] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:02 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:09:03.248173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:03.250243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:03.259921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:03.260440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:03.260871 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:03.261568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:03.262012 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:03.262430 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:03.318762 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:03.319306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:03.325849 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:03.326667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:03.327185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:03.328149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:03.328815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:03.329310 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:03.565899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:03.578258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d52f096a-7255-4608-a7a9-e8285777cf7d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1514 microversion: 2.1 time: 0.263129 Sep 01 18:09:03.590841 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 267/519] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:03 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:03.597044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:03.607097 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:03.611039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:03.613363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d83dea1a-dc6e-46aa-ae2b-7168fad9757e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.369565 Sep 01 18:09:03.614640 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 253/520] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:03 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:04.601112 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:04.602284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:04.613023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:04.613871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:04.615071 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:04.616003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:04.616803 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:04.617446 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:04.652174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:04.656552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:04.674781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:04.676875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:04.679214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:04.682161 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:04.683233 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:04.685019 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:04.829574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:04.838941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1a749dd5-498a-41a3-86d1-b4958df844a7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1514 microversion: 2.1 time: 0.241740 Sep 01 18:09:04.847099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 268/521] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:04 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:04.967516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:04.986123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:04.989469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:04.993910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e141a705-3946-4ab8-8a41-30932e3471fc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.357180 Sep 01 18:09:05.010671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 254/522] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:04 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:05.469737 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-35c7ec93-bc53-4623-8ec7-450ffee88911 req-3057821a-730d-4545-94cc-58d947b1618c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6373140-91e1-4789-90f1-1454c4504907", "name": "network-vif-deleted", "tag": "a64404e7-a5df-4042-8b13-9ef4b4932bfa"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:05.480426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-35c7ec93-bc53-4623-8ec7-450ffee88911 req-3057821a-730d-4545-94cc-58d947b1618c service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:05.480909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-35c7ec93-bc53-4623-8ec7-450ffee88911 req-3057821a-730d-4545-94cc-58d947b1618c service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:05.481537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-35c7ec93-bc53-4623-8ec7-450ffee88911 req-3057821a-730d-4545-94cc-58d947b1618c service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:05.495728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-35c7ec93-bc53-4623-8ec7-450ffee88911 req-3057821a-730d-4545-94cc-58d947b1618c service nova] Creating event network-vif-deleted:a64404e7-a5df-4042-8b13-9ef4b4932bfa for instance e6373140-91e1-4789-90f1-1454c4504907 on hv-cinder-74915 Sep 01 18:09:05.504168 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-35c7ec93-bc53-4623-8ec7-450ffee88911 req-3057821a-730d-4545-94cc-58d947b1618c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039154 Sep 01 18:09:05.508370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 269/523] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:09:05.862544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:05.863270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:05.869854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:05.870335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:05.870798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:05.871487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:05.871937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:05.872389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:05.935356 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:05.946627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f3dbc86e-f3e7-4a02-b14e-6531dfc32227 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1472 microversion: 2.1 time: 0.088209 Sep 01 18:09:05.947285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 255/524] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:05 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1472 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:06.027069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:06.027766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:06.034668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:06.035147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:06.035577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:06.036265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:06.036743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:06.037169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:06.166304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:06.175268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:06.176749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:06.177912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1fd2b074-b761-4378-ab0c-68996cb1235b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.155151 Sep 01 18:09:06.178473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 270/525] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:06 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:06.969786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:06.970502 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:06.977620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:06.978516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:06.979230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:06.980197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:06.981045 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:06.981706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:07.018311 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:07.019064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:07.019665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:07.020291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lazy-loading 'fault' on Instance uuid e6373140-91e1-4789-90f1-1454c4504907 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:09:07.067453 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:07.075893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d88787ad-f93f-4b10-a33e-bc8389a1eed3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 200 len: 1308 microversion: 2.1 time: 0.111185 Sep 01 18:09:07.076484 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 256/526] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:06 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:07.202269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:07.203264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:07.209761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:07.210246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:07.210689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:07.211366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:07.211813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:07.212227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:07.355275 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:07.364456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:07.365887 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:07.367117 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-15d199ca-39bd-45c2-95e8-0d0c97f7b037 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.168856 Sep 01 18:09:07.367665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 271/527] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:07 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:08.096846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:08.097379 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: e6373140-91e1-4789-90f1-1454c4504907] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:08.103747 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:08.104221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:08.104689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:08.111696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:08.111696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:08.111696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:08.119955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] HTTP exception thrown: Instance e6373140-91e1-4789-90f1-1454c4504907 could not be found. Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Request method failure captured: Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 HTTP/1.1 Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPSareEe09cqXfqEXm812oJ0dz2CKElNQxlcyn-PO8uo3ybTLlJqtAyEoTD9PrZh0dIbHw-Sy06CRewCuS_7MWbxnoZ3oXJ_zw229XLv8uwzzdxhKbZ2lhsXEbP7VF9MFtptovZth2av-nCf1ZFsrkgbEDkvPTbLsemWkO0J8_Z4_8s Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: ab11fffacccb4f248d76d99553bdb2a9 Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1382973465 Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:09:08.121605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ab11fffacccb4f248d76d99553bdb2a9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ab11fffacccb4f248d76d99553bdb2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ab11fffacccb4f248d76d99553bdb2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ab11fffacccb4f248d76d99553bdb2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesSnapshotTestJSON-1382973465 Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: ab11fffacccb4f248d76d99553bdb2a9 Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1382973465 Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesSnapshotTestJSON-1382973465-project Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 6201e7d144874370b4da432a529014d2 Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesSnapshotTestJSON-1382973465-project Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance e6373140-91e1-4789-90f1-1454c4504907 could not be found. Sep 01 18:09:08.123220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'e6373140-91e1-4789-90f1-1454c4504907'} Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6373140-91e1-4789-90f1-1454c4504907 could not be found. Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:09:08.124154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6373140-91e1-4789-90f1-1454c4504907 could not be found. Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6373140-91e1-4789-90f1-1454c4504907 could not be found. Sep 01 18:09:08.126388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:09:08.127741 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Returning 404 to user: Instance e6373140-91e1-4789-90f1-1454c4504907 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:09:08.127741 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-82b13563-a187-4861-b22b-d2368bebcd31 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907" status: 404 len: 111 microversion: 2.1 time: 0.030268 Sep 01 18:09:08.127741 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 257/528] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:08 2022] GET /compute/v2.1/servers/e6373140-91e1-4789-90f1-1454c4504907 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:09:08.390267 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:08.402787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:08.402787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:08.402787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:08.402787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:08.403726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:08.403726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:08.403726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:08.531178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:08.539761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:08.541257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:08.542416 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9c4ad9b7-c9d5-4422-8f8d-686c8ed9a6dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1739 microversion: 2.20 time: 0.156306 Sep 01 18:09:08.542968 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 272/529] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:08 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:09:09.569268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:09.569839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:09.578908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:09.579383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:09.579810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:09.580522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:09.580967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:09.581381 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:09.712131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:09.720562 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:09.722042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:09.723199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-53016879-fded-417d-b474-7aaeaecc731f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1721 microversion: 2.20 time: 0.157992 Sep 01 18:09:09.723755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 258/530] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:09 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:10.747368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:10.748008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:10.754806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:10.755292 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:10.755727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:10.756445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:10.756907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:10.757331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:10.883576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:10.892165 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:10.893601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:10.894893 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7e15e4d2-fc67-49fd-9111-4a14b0f559ab tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1721 microversion: 2.20 time: 0.151306 Sep 01 18:09:10.895449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 273/531] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:10 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:11.917774 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:11.918292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:11.924901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:11.925378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:11.925809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:11.926524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:11.926976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:11.927398 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:12.057700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:12.066247 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:12.067679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:12.068867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4958ef04-5d97-419e-927b-5fa06610b32b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1721 microversion: 2.20 time: 0.155130 Sep 01 18:09:12.069439 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 259/532] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:11 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:12.133831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-ccef361f-5461-4315-a436-a2d0f9f88a4a req-4072b3f4-3680-4394-b4b5-8bb53e7f7ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47", "name": "network-vif-unplugged", "status": "completed", "tag": "2f84538c-e0cf-462c-ba99-07996763dee1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:12.143995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ccef361f-5461-4315-a436-a2d0f9f88a4a req-4072b3f4-3680-4394-b4b5-8bb53e7f7ace service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:12.144533 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ccef361f-5461-4315-a436-a2d0f9f88a4a req-4072b3f4-3680-4394-b4b5-8bb53e7f7ace service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:12.144993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ccef361f-5461-4315-a436-a2d0f9f88a4a req-4072b3f4-3680-4394-b4b5-8bb53e7f7ace service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:12.156353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-ccef361f-5461-4315-a436-a2d0f9f88a4a req-4072b3f4-3680-4394-b4b5-8bb53e7f7ace service nova] Creating event network-vif-unplugged:2f84538c-e0cf-462c-ba99-07996763dee1 for instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 on hv-cinder-74915 Sep 01 18:09:12.161491 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-ccef361f-5461-4315-a436-a2d0f9f88a4a req-4072b3f4-3680-4394-b4b5-8bb53e7f7ace service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031490 Sep 01 18:09:12.162047 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 274/533] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:09:13.092094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:13.092707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:13.099546 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:13.100023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:13.100485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:13.101171 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:13.101619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:13.102039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:13.228298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:13.237364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:13.238810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:13.239977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8ce32c65-8728-46eb-809a-ca38769380bc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1721 microversion: 2.20 time: 0.151834 Sep 01 18:09:13.240563 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 260/534] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:13 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:14.263636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:14.264331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:14.271068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:14.284015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:14.284015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:14.284015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:14.284015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:14.284458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:14.411535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:14.419839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:14.421410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:14.422676 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a6c3d97c-e1a6-4f9c-823d-2948a0c42fb5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1721 microversion: 2.20 time: 0.163432 Sep 01 18:09:14.423236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 275/535] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:14 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:15.446049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:15.446646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:15.453127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:15.453601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:15.454027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:15.454854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:15.455303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:15.455886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:15.597337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:15.605231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:15.606689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:15.608034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-11c9fbbe-0a87-4b7e-8ad4-c7a2815b84fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1664 microversion: 2.20 time: 0.166148 Sep 01 18:09:15.609175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 261/536] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:15 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:15.630259 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00d8055a-70b3-4c10-8493-2f6f6e671133"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:15.632572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:15.638479 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:15.638954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:15.639384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:15.640991 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:15.641441 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:15.641872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:17.101968 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ce6febc4-7b38-45b4-ae94-74233a9157c5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.475569 Sep 01 18:09:17.102649 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 276/537] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Sep 1 18:09:15 2022] POST /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments => generated 188 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:09:17.226440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:17.227026 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:17.229401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=50 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:17.234068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:17.234555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:17.234990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:17.235687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:17.236139 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:17.236585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:17.429239 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121220) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 18:09:17.573299 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:17.791909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a9bbc635-9dab-4aef-95fd-935cdda99b9d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/action" status: 202 len: 0 microversion: 2.20 time: 0.569094 Sep 01 18:09:17.792846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 262/538] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 1 18:09:17 2022] POST /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:09:17.802902 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:17.803942 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:17.814655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:17.814655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:17.815213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:17.815425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:17.815871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:17.816286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:17.820799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:17.976655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:18.010817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:18.013495 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:18.015496 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4caebbff-048e-4c75-82cf-4392ebbf1ebb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1750 microversion: 2.20 time: 0.217960 Sep 01 18:09:18.016898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 277/539] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:17 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1750 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:19.042648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:19.043308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:19.051175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:19.051663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:19.052105 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:19.052834 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:19.053291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:19.053790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:19.194585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:19.203809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:19.205374 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:19.206924 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cc31a813-30e5-4e28-9186-991c4c678cdc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1750 microversion: 2.20 time: 0.169302 Sep 01 18:09:19.207849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 263/540] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:19 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:20.230206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:20.230849 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:20.232958 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:20.238816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:20.239382 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:20.239810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:20.240659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:20.241106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:20.241519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:20.371523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:20.380909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:20.382344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:20.383487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-17218d2f-47a1-4d16-8c66-ac74e0dc152c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1750 microversion: 2.20 time: 0.157723 Sep 01 18:09:20.384041 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 278/541] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:20 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:21.406758 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:21.407363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:21.413663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:21.414163 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:21.414595 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:21.415278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:21.415725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:21.416142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:21.545581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:21.554817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:21.556381 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:21.557702 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-298fee69-3647-4be8-98a8-72b790910a91 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1752 microversion: 2.20 time: 0.155039 Sep 01 18:09:21.558341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 264/542] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:21 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:21.941180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1918324181", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "networks": [{"uuid": "3f79830d-12b2-4025-87aa-90dccfaee569"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:21.995004 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] validate_networks() for [('3f79830d-12b2-4025-87aa-90dccfaee569', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:09:22.423845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:09:22.424269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:09:22.424844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:09:22.425249 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:09:22.425654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:09:22.434968 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:22.435447 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:22.435877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:22.436619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:22.437064 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:22.437514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:22.454549 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Getting quotas for project ab11fffacccb4f248d76d99553bdb2a9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:09:22.458436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Getting quotas for user 6201e7d144874370b4da432a529014d2 and project ab11fffacccb4f248d76d99553bdb2a9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:09:22.469831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:09:22.472171 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:09:22.582252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:22.582862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:22.589317 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:22.589863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:22.590305 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:22.590992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:22.591444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:22.591868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:22.663810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a8b63449-70d6-4143-b9c9-8eb1c58cdcb9 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727035 Sep 01 18:09:22.664986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 279/543] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:09:22.675617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dfc6358d-22d9-461d-9ad1-dbf50087b1dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:22.676224 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dfc6358d-22d9-461d-9ad1-dbf50087b1dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:22.732571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:22.745907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:22.746142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dfc6358d-22d9-461d-9ad1-dbf50087b1dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:22.749617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:22.751806 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-17dc34f9-6168-4cb0-b7d8-f2ddcbf4061c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1752 microversion: 2.20 time: 0.174018 Sep 01 18:09:22.752378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 265/544] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:22 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:09:22.754833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dfc6358d-22d9-461d-9ad1-dbf50087b1dc tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1219 microversion: 2.1 time: 0.083457 Sep 01 18:09:22.767755 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 280/545] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:22 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:09:23.775335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:23.775892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:23.776475 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:23.777232 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:23.784425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:23.784996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:23.785139 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:23.785491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:23.785595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:23.785922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:23.786415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:23.786619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:23.786998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:23.787097 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:23.787532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:23.787741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:23.854565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:23.862387 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-469947e0-195f-4228-888e-8844b074a688 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1223 microversion: 2.1 time: 0.091030 Sep 01 18:09:23.863096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 281/546] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:23 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:23.924327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:23.933103 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:23.934556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:23.935881 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-74bf85e6-219b-48fc-b513-36c301faed93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.164660 Sep 01 18:09:23.936773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 266/547] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:23 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:24.883290 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:24.883893 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:24.891704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:24.892462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:24.892898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:24.893596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:24.894075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:24.894503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:24.960138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:24.960604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:24.961440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:24.965545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:09:24.965879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Thu Sep 1 18:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 (ip 10.222.0.15) !!! Sep 01 18:09:24.970217 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5a52b24b-bd7e-4d8c-9776-4089d56abe40 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1271 microversion: 2.1 time: 0.089501 Sep 01 18:09:24.971217 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 282/548] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:24 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:24.973660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:24.974318 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:24.974757 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:24.975496 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:24.975948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:24.976404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:25.113717 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:25.122408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:25.123854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:25.125829 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d0368b42-4fab-4d23-8b5d-73a6f2812884 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.169857 Sep 01 18:09:25.126457 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 267/549] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:24 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:25.995650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:25.996374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:26.002412 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:26.002885 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:26.003546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:26.004232 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:26.004704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:26.005120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:26.068668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:26.079311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c04c84b9-ca32-4351-b9a5-b7df47e875a8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1289 microversion: 2.1 time: 0.087249 Sep 01 18:09:26.093030 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 283/550] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:25 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:26.153141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:26.154854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:26.166406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:26.169810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:26.170509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:26.172355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:26.173352 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:26.174801 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:26.481799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:26.498068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:26.500450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:26.501329 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2c0194a0-72e1-4bac-a60d-acf2fc1b3557 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.353692 Sep 01 18:09:26.507315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 268/551] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:26 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:27.100178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:27.100811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:27.107244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:27.107731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:27.108158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:27.109449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:27.110250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:27.110771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:27.244423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:27.253771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-440f9bd5-b564-44ab-bcdb-fae40a04b404 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.157518 Sep 01 18:09:27.254748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 284/552] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:27 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:27.526109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:27.526652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:27.533551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:27.534289 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:27.534714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:27.535391 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:27.535836 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:27.536285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:27.688463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:27.697150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:27.703702 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:27.703702 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ed443277-d51c-45c6-a2ca-dab7a8713d0d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.177547 Sep 01 18:09:27.703702 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 269/553] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:27 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:28.275688 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:28.276276 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:28.283096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:28.283579 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:28.284269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:28.284993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:28.285439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:28.285858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:28.420015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:28.429007 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e14b3adf-aab2-480b-a1d7-e721e11732cb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.157784 Sep 01 18:09:28.429602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 285/554] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:28 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:28.725912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:28.751723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:28.751723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:28.751723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:28.751723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:28.753083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:28.753083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:28.753083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:28.881298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:28.891007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:28.892538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:28.893704 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dcf167f6-a54d-4d38-ac6d-3fd7a398b6ea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.173358 Sep 01 18:09:28.894317 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 270/555] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:28 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:29.452049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:29.452810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:29.459125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:29.463759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:29.463759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:29.463759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:29.463759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:29.464106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:29.605207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:29.613915 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-60e9cf8e-d43f-42de-bdc0-36ad5649b468 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.167658 Sep 01 18:09:29.614470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 286/556] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:29 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:29.918605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:29.920079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:29.927812 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:29.928732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:29.929518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:29.930485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:29.931005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:29.931504 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:30.070831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:30.080214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:30.081831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:30.083322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0d174345-5d95-4449-92c7-9d333c9fc018 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.169248 Sep 01 18:09:30.084131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 271/557] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:29 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:30.639284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:30.640384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:30.650686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:30.651871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:30.652932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:30.654383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:30.655366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:30.657201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:30.813089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:30.821058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a1323a4f-3107-4eb4-91be-346f7d35a541 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.188640 Sep 01 18:09:30.826342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 287/558] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:30 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:09:31.108015 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:31.109623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:31.117034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:31.117531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:31.117963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:31.118720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:31.119170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:31.119591 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:31.256565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:31.266805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:31.268359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:31.269723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bc267a8b-4b88-48c8-84bb-5d135fc7a0e9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.166217 Sep 01 18:09:31.270281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 272/559] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:31 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:31.841873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:31.842477 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:31.849453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:31.850234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:31.850853 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:31.851744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:31.852417 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:31.853002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:31.987070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:31.994637 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-df8c4967-9815-42b7-b7a7-e081df27e2e7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.156602 Sep 01 18:09:31.995186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 288/560] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:31 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:32.293793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:32.294424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:32.301867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:32.302348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:32.302781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:32.303472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:32.303925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:32.304367 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:32.443995 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:32.454039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:32.455789 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:32.457165 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7baf7ed9-dbd7-4268-9e93-5b914c8061d2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.167315 Sep 01 18:09:32.457756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 273/561] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:32 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:33.017760 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:33.018335 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:33.020123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:33.020866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=8 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:33.025582 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:33.026062 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:33.026493 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:33.027177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:33.027625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:33.028048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:33.168410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:33.176092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dd00c831-b1d0-49c8-80b4-645d8c3c3f43 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.162930 Sep 01 18:09:33.176684 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 289/562] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:33 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:33.480773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:33.481435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:33.489322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:33.489816 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:33.490255 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:33.490960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:33.491410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:33.491889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:33.653201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:33.662944 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:33.664804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:33.666250 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4dd49b69-8203-4629-9676-707ccb790f72 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.189685 Sep 01 18:09:33.667377 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 274/563] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:33 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:34.196949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:34.197608 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:34.204101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:34.204614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:34.205077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:34.205769 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:34.206256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:34.206681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:34.340814 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:34.349334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0677a0d4-4e68-4fb8-b6ca-04407651cce3 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.156185 Sep 01 18:09:34.360343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 290/564] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:34 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:34.690583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:34.691199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:34.697699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:34.698174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:34.698599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:34.699286 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:34.699733 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:34.700274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:34.842317 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:34.851029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:34.852492 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:34.853724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2b7a32b8-8443-4c8c-a500-65034954bd07 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.167234 Sep 01 18:09:34.854205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 275/565] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:34 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:35.371089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:35.371767 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:35.378383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:35.378854 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:35.379280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:35.379948 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:35.380412 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:35.380831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:35.537073 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:35.544819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a1320676-f6d4-4147-b0d8-5db070ad44bb tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.177630 Sep 01 18:09:35.545368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 291/566] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:35 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:35.876719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:35.877334 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:35.884535 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:35.885016 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:35.885442 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:35.886137 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:35.886660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:35.887193 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:36.026325 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:36.035921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:36.037800 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:36.039404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a4788548-2436-4694-9c05-0cbe7ebb3f8b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.167104 Sep 01 18:09:36.040182 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 276/567] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:35 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:36.566279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:36.567594 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:36.574039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:36.574837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:36.575497 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:36.576453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:36.578039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:36.578681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:36.728848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:36.738768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7692a907-49f7-4585-8e21-cefdfdd9cade tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.176726 Sep 01 18:09:36.739841 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 292/568] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:36 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:37.062879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:37.063500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:37.070031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:37.070511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:37.070944 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:37.071639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:37.072091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:37.072540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:37.199014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:37.207604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:37.209057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:37.210200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-31d5ffbb-7807-4a51-b63d-a180f23f35aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.151563 Sep 01 18:09:37.210749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 277/569] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:37 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:37.760368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:37.760938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:37.767426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:37.767901 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:37.768347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:37.769030 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:37.769473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:37.769889 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:37.894594 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:37.902182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2ce40175-d72b-4392-a11f-df4bc1225978 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.145741 Sep 01 18:09:37.902857 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 293/570] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:37 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:38.233127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:38.234310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:38.240857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:38.241328 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:38.241753 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:38.242434 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:38.242876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:38.243289 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:38.371800 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:38.381011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:38.382444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:38.383587 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9b22dc14-8d5d-4598-aa52-5c3b739b0c28 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.154516 Sep 01 18:09:38.384138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 278/571] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:38 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:38.923266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:38.923800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:38.930006 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:38.930482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:38.930908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:38.931607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:38.932070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:38.932496 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:39.073550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:39.081828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-727e01cf-e988-429d-a28c-558d2c2ed322 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.162514 Sep 01 18:09:39.095586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 294/572] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:38 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:39.406451 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:39.407113 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:39.413783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:39.414259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:39.414692 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:39.415380 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:39.415827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:39.416248 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:39.421301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:39.558703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:39.567974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:39.569602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:39.570746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4bdd2bca-2148-4d3a-840b-b2948307cafb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.168512 Sep 01 18:09:39.571295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 279/573] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:39 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:40.103077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:40.103628 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:40.110964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:40.111450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:40.111883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:40.112673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:40.113068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:40.113495 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:40.134138 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:40.251577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:40.260449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f9829372-c17e-4781-8b86-a969f079e106 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.161231 Sep 01 18:09:40.261330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 295/574] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:40 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:40.595034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:40.595660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:40.602120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:40.602619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:40.603039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:40.603722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:40.604169 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:40.604618 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:40.731075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:40.739794 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:40.749644 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:40.750831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f936f9a2-3041-4e0f-bb61-315404620131 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.160476 Sep 01 18:09:40.751398 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 280/575] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:40 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:41.283320 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:41.284181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:41.290309 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:41.290795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:41.291228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:41.291915 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:41.292378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:41.292799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:41.420204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:41.428222 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-88b51f2a-bfc3-4a69-b497-f62aca38cc5c tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.148901 Sep 01 18:09:41.428810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 296/576] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:41 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:09:41.776266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:41.776937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:41.783409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:41.787274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:41.787274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:41.787274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:41.787274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:41.787665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:41.923710 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:41.932359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:41.933810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:41.934961 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4d758fa5-f1b6-4a14-b74d-05fc70452922 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.162637 Sep 01 18:09:41.935517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 281/577] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:41 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:42.449266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:42.449910 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:42.456175 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:42.456681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:42.457112 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:42.457794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:42.458241 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:42.458658 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:42.586327 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:42.594754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f0f5b614-5946-4f0a-83ff-c94fb30ec253 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.149390 Sep 01 18:09:42.595325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 297/578] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:42 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:42.957944 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:42.958548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:42.964995 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:42.965474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:42.965907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:42.966626 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:42.967075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:42.967498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:43.095126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:43.103699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:43.105174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:43.106335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a867f983-ff79-49b1-92b3-63c4e6da3785 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.152440 Sep 01 18:09:43.106888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 282/579] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:42 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:43.615271 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:43.615876 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:43.621818 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:43.622296 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:43.622723 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:43.623403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:43.623908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:43.625606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:43.757125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:43.764774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5a380ca8-b08e-4e2e-aa4c-0af23971e203 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.153249 Sep 01 18:09:43.765359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 298/580] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:43 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:44.128994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:44.132425 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:44.136226 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:44.136735 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:44.137170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:44.137969 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:44.138424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:44.138846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:44.312863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:44.321788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:44.323230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:44.324454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-70ade70e-9335-4f21-914c-f9768320e8ff tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.199345 Sep 01 18:09:44.324962 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 283/581] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:44 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:09:44.527269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-08e07f73-bac8-446c-9331-f1b587af9fed req-6bace62e-fce5-4c52-b453-ad35414b25e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a64243-dacf-4bdf-a259-8c0b05710dc6", "tag": "313d2e47-5c51-4102-b1a0-c4b67c161fac"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:44.537098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-08e07f73-bac8-446c-9331-f1b587af9fed req-6bace62e-fce5-4c52-b453-ad35414b25e9 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:44.537572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-08e07f73-bac8-446c-9331-f1b587af9fed req-6bace62e-fce5-4c52-b453-ad35414b25e9 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:44.538001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-08e07f73-bac8-446c-9331-f1b587af9fed req-6bace62e-fce5-4c52-b453-ad35414b25e9 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:44.549731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-08e07f73-bac8-446c-9331-f1b587af9fed req-6bace62e-fce5-4c52-b453-ad35414b25e9 service nova] Creating event network-changed:313d2e47-5c51-4102-b1a0-c4b67c161fac for instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 on hv-cinder-74915 Sep 01 18:09:44.554480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-08e07f73-bac8-446c-9331-f1b587af9fed req-6bace62e-fce5-4c52-b453-ad35414b25e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148949 Sep 01 18:09:44.558318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 299/582] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:09:44.785465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:44.786069 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:44.792037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:44.792558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:44.792992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:44.793679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:44.794126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:44.794548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:44.924474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:44.932028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4cc3adc8-ba2e-458e-a397-9f6f9a37b1f1 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.150655 Sep 01 18:09:44.932623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 284/583] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:44 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:45.348909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:45.349602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:45.355746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:45.356227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:45.356739 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:45.357437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:45.357886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:45.358949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:45.489260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:45.497780 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:45.499535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:45.500387 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e0f667cf-8873-46bb-9dc1-71bb9b8a9c8f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.155782 Sep 01 18:09:45.500938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 300/584] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:45 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:45.960386 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:45.961000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:45.967431 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:45.967912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:45.968456 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:45.969327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:45.969782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:45.970206 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:46.109339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:46.117415 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2f9c2f1e-8909-4a39-9466-56c482fc4125 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.160983 Sep 01 18:09:46.117986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 285/585] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:45 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:46.523129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:46.529665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:46.530928 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:46.531408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:46.532111 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:46.533007 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:46.533601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:46.534475 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:46.677835 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:46.687940 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:46.689455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:46.690610 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cce1b87d-2cd4-4c71-97c2-f8e00947264b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.172050 Sep 01 18:09:46.691354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 301/586] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:46 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:47.138449 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:47.139052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:47.145912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:47.146388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:47.146813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:47.147494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:47.147937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:47.148448 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:47.280086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:47.288906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-44417549-8b5b-4f46-8ede-223fcb4e19e6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.154559 Sep 01 18:09:47.289463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 286/587] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:47 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:47.713457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:47.714053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:47.720156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:47.720801 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:47.721250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:47.722097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:47.722582 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:47.723144 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:47.853891 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:47.862981 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:47.864485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:47.868963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-36b4bba8-37b0-4c18-a275-ce91718ce2dc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.156160 Sep 01 18:09:47.868963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 302/588] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:47 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:48.378847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:48.378847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:48.378847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:48.378847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:48.378847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:48.379624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:48.379624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:48.379624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:48.379624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:48.452756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:48.458200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e325ff2c-a761-4c56-9680-3dc7e6fcec58 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.151098 Sep 01 18:09:48.458767 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 287/589] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:48 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:48.889302 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:48.890447 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:48.896681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:48.897153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:48.897583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:48.898257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:48.898699 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:48.899114 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:49.032949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:49.041679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:49.043110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:49.044252 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-28bda321-6b13-4184-b8f3-3fdd3932bb58 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.158795 Sep 01 18:09:49.044840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 303/590] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:48 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:49.478992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:49.479607 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:49.487298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:49.487784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:49.488221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:49.488944 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:49.489413 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:49.489830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:49.623207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:49.631809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2dd1666f-e66d-462a-aea1-0657887b352e tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.156719 Sep 01 18:09:49.632379 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 288/591] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:49 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:50.067256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:50.067874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:50.073783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:50.074258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:50.074683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:50.075359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:50.075963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:50.076405 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:50.205258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:50.214453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:50.215880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:50.217061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b080f41c-4b05-4255-a077-09556c6de8b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.153911 Sep 01 18:09:50.217652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 304/592] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:50 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:50.652815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:50.653337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:50.660406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:50.660911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:50.661340 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:50.662027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:50.662480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:50.662899 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:50.793235 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:50.797013 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-89d5f1e1-b3e7-4cbf-8abf-20b35ccab1b8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.148355 Sep 01 18:09:50.797585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 289/593] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:50 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:51.241257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:51.241778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:51.243835 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:51.248461 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:51.248931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:51.249384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:51.250298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:51.250744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:51.251162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:51.434944 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:51.434944 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:51.435233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:51.435233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fc8e33f0-87d9-4644-bac7-76ddf3572a0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.163808 Sep 01 18:09:51.435233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 305/594] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:51 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:51.817788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:51.820921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:51.824305 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:51.824829 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:51.825253 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:51.825944 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:51.826397 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:51.826824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:51.958121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:51.965758 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-aa034fd0-a7c8-4980-842a-318aa6dd5015 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.152104 Sep 01 18:09:51.966412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 290/595] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:51 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:52.358334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-5d9d0b54-7f30-4a8b-8787-9e21637c9430 req-261f37f6-3fa2-490c-8b79-5bdb105d49e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a64243-dacf-4bdf-a259-8c0b05710dc6", "name": "network-vif-plugged", "status": "completed", "tag": "313d2e47-5c51-4102-b1a0-c4b67c161fac"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:52.368639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5d9d0b54-7f30-4a8b-8787-9e21637c9430 req-261f37f6-3fa2-490c-8b79-5bdb105d49e2 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:52.369102 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5d9d0b54-7f30-4a8b-8787-9e21637c9430 req-261f37f6-3fa2-490c-8b79-5bdb105d49e2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:52.369673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5d9d0b54-7f30-4a8b-8787-9e21637c9430 req-261f37f6-3fa2-490c-8b79-5bdb105d49e2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:52.382181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-5d9d0b54-7f30-4a8b-8787-9e21637c9430 req-261f37f6-3fa2-490c-8b79-5bdb105d49e2 service nova] Creating event network-vif-plugged:313d2e47-5c51-4102-b1a0-c4b67c161fac for instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 on hv-cinder-74915 Sep 01 18:09:52.386379 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-5d9d0b54-7f30-4a8b-8787-9e21637c9430 req-261f37f6-3fa2-490c-8b79-5bdb105d49e2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094875 Sep 01 18:09:52.386958 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 306/596] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:09:52.432235 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:52.432912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:52.439400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:52.439881 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:52.440532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:52.441233 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:52.441682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:52.442133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:52.576770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:52.585764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:52.587238 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:52.588584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9cbddf4c-b409-4381-b321-54cbbc713d9f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.160978 Sep 01 18:09:52.589133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 291/597] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:52 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:52.988084 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:52.988824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:52.995270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:52.995745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:52.996173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:52.996886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:52.997333 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:52.997773 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:53.126813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:53.134430 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a28855a4-4e7d-4b74-a593-006be6bc5f13 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.151474 Sep 01 18:09:53.134991 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 307/598] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:52 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:53.611120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:53.611871 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:53.619140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:53.619286 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:53.619971 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:53.620710 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:53.621204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:53.621690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:53.761252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:53.770494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:53.771922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:53.773092 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1e8c63c4-5fef-4788-a493-cf38f1f57ba2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.165905 Sep 01 18:09:53.773645 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 292/599] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:53 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:54.155187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:54.156652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:54.163371 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:54.167956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:54.167956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:54.167956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:54.167956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:54.168367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:54.316718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:54.325217 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-94e7a83d-b58e-465f-b0c7-f7cddfe9cc87 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.173835 Sep 01 18:09:54.325827 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 308/600] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:54 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:54.795488 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:54.796669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:54.803173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:54.803651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:54.804083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:54.804826 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:54.805273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:54.805694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:55.080680 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:55.097044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:55.098700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:55.099908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7b6967e2-7664-4edc-a768-a4de7191ea4f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.308379 Sep 01 18:09:55.100499 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 293/601] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:54 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:55.348020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:55.348661 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:55.355352 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:55.355837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:55.356278 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:55.357135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:55.357636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:55.358059 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:55.503582 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:55.511395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-af24bb18-7efd-4201-ab1e-88768758c321 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.168377 Sep 01 18:09:55.511966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 309/602] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:55 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:56.125172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:56.125920 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:56.132265 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:56.132774 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:56.133214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:56.133906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:56.134361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:56.134788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:56.270625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:56.279404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:56.280865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:56.282013 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7806be3b-5a02-42d2-9209-e5dca814ac15 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.161332 Sep 01 18:09:56.283332 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 294/603] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:56 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:56.477778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-e3622e24-629b-45db-bd89-909e179a765a req-eb5a0903-9c34-485b-8658-79767b8c5827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47", "name": "network-vif-plugged", "status": "completed", "tag": "2f84538c-e0cf-462c-ba99-07996763dee1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:56.487912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e3622e24-629b-45db-bd89-909e179a765a req-eb5a0903-9c34-485b-8658-79767b8c5827 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:56.488415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e3622e24-629b-45db-bd89-909e179a765a req-eb5a0903-9c34-485b-8658-79767b8c5827 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:56.488848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-e3622e24-629b-45db-bd89-909e179a765a req-eb5a0903-9c34-485b-8658-79767b8c5827 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:56.501531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-e3622e24-629b-45db-bd89-909e179a765a req-eb5a0903-9c34-485b-8658-79767b8c5827 service nova] Creating event network-vif-plugged:2f84538c-e0cf-462c-ba99-07996763dee1 for instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 on hv-cinder-74915 Sep 01 18:09:56.507786 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-e3622e24-629b-45db-bd89-909e179a765a req-eb5a0903-9c34-485b-8658-79767b8c5827 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 Sep 01 18:09:56.508767 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 310/604] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:09:56.534666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:56.535409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:56.541863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:56.542977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:56.543341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:56.544209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:56.544689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:56.545196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:56.677801 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:56.681880 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:56.687218 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5b8f7232-8d46-454e-aa47-17bfccd5f996 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1319 microversion: 2.1 time: 0.157821 Sep 01 18:09:56.687796 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 295/605] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:56 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:57.306784 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:57.307537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:57.314180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:57.314662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:57.315154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:57.315799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:57.316230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:57.316704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:57.449579 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:57.458493 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:57.460014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:57.461180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b57db8cb-6638-4a21-ace0-a8539a6237f3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.158674 Sep 01 18:09:57.464744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 311/606] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:57 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:09:57.708658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:57.709270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:57.715753 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:57.716231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:57.716686 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:57.717383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:57.717861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:57.718366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:57.847044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:57.854814 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5de73dbb-e13a-410d-abd0-9fe0bb151f67 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1509 microversion: 2.1 time: 0.150425 Sep 01 18:09:57.855371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 296/607] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:09:57 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:09:57.875248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7450c5b-02d7-4bcf-8f1a-066362ef647e", "device": "/dev/sdb"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:09:57.878259 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:57.884331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:57.884831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:57.885326 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:57.885998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:57.886472 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:57.886880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:58.487324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:58.487924 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:58.493815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:58.494292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:58.494723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:58.495403 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:58.495848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:58.496264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:58.628288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:58.636841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:58.638299 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:58.639440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-146fb3b7-148e-402f-9b27-31175a720ad0 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.156554 Sep 01 18:09:58.639988 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 297/608] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:58 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:09:59.663064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:09:59.663829 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:09:59.672640 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:59.674639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:59.674639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:59.674639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:09:59.674926 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:09:59.675281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:09:59.796022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:09:59.818603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:59.828083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:59.829746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:09:59.831089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f7e27833-2dcf-4d2b-b5d8-b5061e043a2f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.172513 Sep 01 18:09:59.831636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 298/609] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:09:59 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:09:59.991872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-916c88f8-1bd4-43a3-bfa1-55a914a6b750 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "POST /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.120606 Sep 01 18:09:59.992677 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 312/610] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:09:57 2022] POST /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6/os-volume_attachments => generated 194 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:10:00.855372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:00.855372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:00.864800 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:00.865524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:00.866418 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:00.867268 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:00.867984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:00.868736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:01.008613 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:01.020627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:01.020627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:01.020883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e0936a93-b8fd-47e6-9325-b56704fe0e35 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1808 microversion: 2.20 time: 0.170881 Sep 01 18:10:01.021465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 299/611] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:10:00 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:10:02.045577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:02.046861 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:02.053236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:02.053709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:02.054136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:02.060410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:02.060410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:02.060410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:02.193523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:02.202697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:02.204624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:02.205795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e91550b3-d34c-4560-9ffd-d68bb230d4af tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1795 microversion: 2.20 time: 0.165291 Sep 01 18:10:02.206339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 313/612] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:10:02 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1795 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:10:16.431134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=25 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:16.431835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=24 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:16.534489 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7978d22-bd07-4a59-9277-74dc06c96764"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:10:16.537010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:16.542920 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:16.543405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:16.543869 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:16.544590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:16.545053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:16.545578 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:17.428765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-379849a1-4460-4d0f-8f67-d13bc36ae76c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.000433 Sep 01 18:10:17.428765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 300/613] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:10:16 2022] POST /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments => generated 194 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:10:29.408650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:10:29.411150 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:29.413385 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=17 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:29.414032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:29.418750 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:29.419225 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:29.419655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:29.420882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:29.421333 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:29.421747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:29.445706 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lazy-loading 'flavor' on Instance uuid 6d0e643e-dad7-4451-abce-e4481f372f3d {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:10:29.979731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2d7283d0-b08a-4770-9114-9643a0e017e9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/action" status: 200 len: 32 microversion: 2.1 time: 0.575309 Sep 01 18:10:29.980422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 314/614] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:10:29 2022] POST /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/action => generated 32 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:10:29.990984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:29.991676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:29.994185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:29.994937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:30.000032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:30.000545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:30.000984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:30.001675 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:30.002126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:30.002552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:30.136658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:30.145482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-df7afdec-1cda-442d-b16a-675ec8d8db6c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.158842 Sep 01 18:10:30.146047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 301/615] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:29 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:30.869759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:30.870515 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:30.877748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:30.878231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:30.878826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:30.879520 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:30.880004 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:30.880420 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:30.967949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lazy-loading 'services' on Instance uuid b3a64243-dacf-4bdf-a259-8c0b05710dc6 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:10:31.167465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:31.168195 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:31.176089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:31.177845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:31.177845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:31.177845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:31.178153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:31.178549 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:31.277865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-12f537d7-f0c2-491b-8353-1f5013cbbba7 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6/os-volume_attachments/b7450c5b-02d7-4bcf-8f1a-066362ef647e" status: 202 len: 0 microversion: 2.1 time: 0.412493 Sep 01 18:10:31.281434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 315/616] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:10:30 2022] DELETE /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6/os-volume_attachments/b7450c5b-02d7-4bcf-8f1a-066362ef647e => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:10:31.313607 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:31.321770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fdd3fa11-7df2-4d59-a8d4-f33af7f052fe tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.158200 Sep 01 18:10:31.322338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 302/617] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:31 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:10:32.351135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:32.351969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:32.359502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:32.359995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:32.360457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:32.361151 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:32.361595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:32.362015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:32.507858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:32.516828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-acef4de4-ad1f-43ca-b46b-cf74632451d0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.170362 Sep 01 18:10:32.517715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 316/618] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:32 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:33.471584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:33.472269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:33.478508 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:33.478987 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:33.479421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:33.480104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:33.480586 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:33.481009 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:33.512104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:10:33.539052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:33.539646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:33.546669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:33.547150 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:33.547602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:33.548297 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:33.548747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:33.549165 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:33.680473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:33.689572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bea18494-c334-446e-b8a2-15d3ed8bcc2d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.154226 Sep 01 18:10:33.690745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 317/619] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:33 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:10:34.007770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-01ce20a2-1e3d-4c28-b76e-f424c6f42d6d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 204 len: 0 microversion: 2.1 time: 0.540035 Sep 01 18:10:34.008385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 303/620] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:10:33 2022] DELETE /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:10:34.016741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:34.017432 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:34.023577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:34.024059 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:34.024530 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:34.025295 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:34.025751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:34.026173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:34.151683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:34.160421 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-268ca43c-a01c-4220-b6a4-8372f0ca7af8 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1515 microversion: 2.1 time: 0.147846 Sep 01 18:10:34.160979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 318/621] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:34 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:34.711723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:34.712441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:34.718793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:34.719266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:34.719696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:34.720401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:34.720846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:34.721260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:34.853687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:34.862667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c9bccc3c-76dd-4aaa-ad5b-8580f0d08d2a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.155144 Sep 01 18:10:34.863234 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 304/622] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:34 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:35.181546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:35.182168 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:35.189158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:35.189631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:35.190086 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:35.190761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:35.191206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:35.191623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:35.322565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:35.330400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-453f4f6b-3db4-4b49-98ab-31d8ba6956a6 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1515 microversion: 2.1 time: 0.152675 Sep 01 18:10:35.330951 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 319/623] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:35 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:35.884094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:35.884729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:35.891856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:35.892352 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:35.892827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:35.893507 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:35.893956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:35.894373 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:36.021961 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:36.030905 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5c57b9d7-593c-4e5d-93ef-16c8ee48a01c tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.150656 Sep 01 18:10:36.031477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 305/624] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:35 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:36.351221 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:36.351844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:36.358336 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:36.358843 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:36.359270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:36.360044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:36.360531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:36.360948 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:36.494139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:36.502797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-435f41d0-01c0-4c34-a241-133adcb96a8d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1515 microversion: 2.1 time: 0.155423 Sep 01 18:10:36.503375 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 320/625] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:36 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:36.802963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-e624603c-7396-4226-8fc4-788ab3f76493 req-fdc8c55c-db79-4935-befd-e3c44fd0e4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a64243-dacf-4bdf-a259-8c0b05710dc6", "name": "network-vif-deleted", "tag": "313d2e47-5c51-4102-b1a0-c4b67c161fac"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:10:36.813143 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-e624603c-7396-4226-8fc4-788ab3f76493 req-fdc8c55c-db79-4935-befd-e3c44fd0e4bc service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:36.813617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-e624603c-7396-4226-8fc4-788ab3f76493 req-fdc8c55c-db79-4935-befd-e3c44fd0e4bc service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:36.814048 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-e624603c-7396-4226-8fc4-788ab3f76493 req-fdc8c55c-db79-4935-befd-e3c44fd0e4bc service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:36.824873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-e624603c-7396-4226-8fc4-788ab3f76493 req-fdc8c55c-db79-4935-befd-e3c44fd0e4bc service nova] Creating event network-vif-deleted:313d2e47-5c51-4102-b1a0-c4b67c161fac for instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 on hv-cinder-74915 Sep 01 18:10:36.830081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-e624603c-7396-4226-8fc4-788ab3f76493 req-fdc8c55c-db79-4935-befd-e3c44fd0e4bc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030785 Sep 01 18:10:36.830656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 306/626] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:10:37.052488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:37.053014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:37.058922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:37.059407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:37.059833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:37.060550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:37.061101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:37.061517 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:37.201937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:37.210140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3f111995-33c2-4850-a646-78f50674ca94 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.161637 Sep 01 18:10:37.210894 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 321/627] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:37 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:37.524966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:37.525835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:37.533473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:37.533952 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:37.534659 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:37.535394 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:37.535863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:37.536273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:37.567200 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:37.567576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:37.568001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:37.568540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lazy-loading 'fault' on Instance uuid b3a64243-dacf-4bdf-a259-8c0b05710dc6 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:10:37.625039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6201e7d144874370b4da432a529014d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab11fffacccb4f248d76d99553bdb2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:37.632628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-64773e84-b5e5-4fab-9548-f0fb28d7834d tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 200 len: 1309 microversion: 2.1 time: 0.111959 Sep 01 18:10:37.633196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 307/628] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:37 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:10:38.232917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:38.233556 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:38.240892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:38.241198 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:38.241619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:38.242326 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:38.243396 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:38.243827 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:38.380937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:38.389459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d40ac716-462a-4211-a229-f7545a049745 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.160914 Sep 01 18:10:38.390078 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 322/629] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:38 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:38.655260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:38.655863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] [instance: b3a64243-dacf-4bdf-a259-8c0b05710dc6] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:38.662567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:38.663037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:38.663525 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:38.664204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:38.664677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:38.665098 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:38.678962 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] HTTP exception thrown: Instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 could not be found. Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Request method failure captured: Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 HTTP/1.1 Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPSareEe09cqXfqEXm812oJ0dz2CKElNQxlcyn-PO8uo3ybTLlJqtAyEoTD9PrZh0dIbHw-Sy06CRewCuS_7MWbxnoZ3oXJ_zw229XLv8uwzzdxhKbZ2lhsXEbP7VF9MFtptovZth2av-nCf1ZFsrkgbEDkvPTbLsemWkO0J8_Z4_8s Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: ab11fffacccb4f248d76d99553bdb2a9 Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1382973465 Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:10:38.680611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ab11fffacccb4f248d76d99553bdb2a9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ab11fffacccb4f248d76d99553bdb2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ab11fffacccb4f248d76d99553bdb2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ab11fffacccb4f248d76d99553bdb2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-VolumesSnapshotTestJSON-1382973465 Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: ab11fffacccb4f248d76d99553bdb2a9 Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1382973465 Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-VolumesSnapshotTestJSON-1382973465-project Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 6201e7d144874370b4da432a529014d2 Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-VolumesSnapshotTestJSON-1382973465-project Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 could not be found. Sep 01 18:10:38.682260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'b3a64243-dacf-4bdf-a259-8c0b05710dc6'} Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 could not be found. Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:10:38.683410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 could not be found. Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 could not be found. Sep 01 18:10:38.684772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:38.686023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] Returning 404 to user: Instance b3a64243-dacf-4bdf-a259-8c0b05710dc6 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:10:38.686023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-322097cd-c214-4952-bbde-42bf442b8385 tempest-VolumesSnapshotTestJSON-1382973465 tempest-VolumesSnapshotTestJSON-1382973465-project] 10.222.0.15 "GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6" status: 404 len: 111 microversion: 2.1 time: 0.031098 Sep 01 18:10:38.686023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 308/630] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:38 2022] GET /compute/v2.1/servers/b3a64243-dacf-4bdf-a259-8c0b05710dc6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:10:39.410952 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:39.411538 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:39.418074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:39.418555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:39.418984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:39.419661 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:39.420106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:39.420551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:39.550098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:39.558704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-36d25904-9862-40b5-be92-ab4a914d05ea tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.151835 Sep 01 18:10:39.559301 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 323/631] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:39 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:40.580879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:40.581419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:40.587828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:40.588303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:40.588756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:40.589441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:40.589883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:40.590320 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:40.719222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:40.727416 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e3b3e11b-c9d4-46fe-993f-c8509b2b9810 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.151299 Sep 01 18:10:40.727974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 309/632] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:40 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:41.748941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:41.749598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:41.756296 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:41.756826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:41.757254 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:41.757929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:41.758421 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:41.758788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:41.913358 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:41.921807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-62d6b410-23e9-4cbe-8e9e-52f23e57ae5e tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.176945 Sep 01 18:10:41.922766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 324/633] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:41 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:42.942410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:42.943012 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:42.949370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:42.949907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:42.950263 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:42.955491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:42.956179 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:42.956656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:43.084496 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:43.093349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-655238be-83db-4884-a789-f3e60731f8aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.154733 Sep 01 18:10:43.099849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 310/634] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:42 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:44.114057 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:44.114694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:44.121048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:44.121521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:44.121947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:44.122622 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:44.123682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:44.124103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:44.250642 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:44.259113 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1578f9e3-8d49-476c-8bfb-8d7fee43c4e3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.148789 Sep 01 18:10:44.261509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 325/635] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:44 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:45.281940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:45.282595 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:45.289434 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:45.289925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:45.290355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:45.291033 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:45.291477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:45.291893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:45.424193 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:45.432330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9e3c7c40-07e4-410d-8cf1-2af4a2a286a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.154608 Sep 01 18:10:45.432903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 311/636] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:45 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:46.454574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:46.455180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:46.461707 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:46.462178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:46.462605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:46.463278 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:46.463720 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:46.464135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:46.591650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:46.602484 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-762c89e7-285f-4cfc-aa56-a007247abe0d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.152111 Sep 01 18:10:46.603097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 326/637] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:46 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:47.622951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:47.623549 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:47.629961 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:47.630442 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:47.630872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:47.631562 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:47.632010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:47.632474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:47.762273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:47.770901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-15a3c5f9-f470-4ee3-81f1-d4c0fbd5941f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.151805 Sep 01 18:10:47.771677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 312/638] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:47 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:48.793478 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:48.799153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:48.803068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:48.803555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:48.804000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:48.804716 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:48.805172 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:48.805600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:48.948843 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:48.952435 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:48.957338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0ebca17e-48f5-4248-bb5f-81cd85806251 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.167754 Sep 01 18:10:48.957892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 327/639] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:48 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:49.979159 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:49.979683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:49.986663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:49.987142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:49.987578 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:49.988265 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:49.988747 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:49.989172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:50.114169 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:50.122337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ecdaf0b3-2f00-4f73-b9c3-300babb7ccf5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1736 microversion: 2.1 time: 0.147224 Sep 01 18:10:50.122924 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 313/640] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:49 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:51.143164 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:51.143764 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:51.150627 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.151102 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.151531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.152203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.152677 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.153094 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.290695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:51.301311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c443de59-a9f7-44d1-8930-6170f895cdb6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1716 microversion: 2.1 time: 0.160663 Sep 01 18:10:51.301311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 328/641] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:51 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:51.407433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:51.407989 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:51.414290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.414761 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.415185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.415857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.416300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.416743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.539543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] HTTP exception thrown: Cannot 'detach_volume' instance 6d0e643e-dad7-4451-abce-e4481f372f3d while it is in vm_state rescued Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Request method failure captured: Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: DELETE /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments/b7978d22-bd07-4a59-9277-74dc06c96764 HTTP/1.1 Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQRvIYMjYUKZZPjSLJWG0HYMhOZB6twqfznx3zIOmiPYq3_YozI0xfIaj3eQibvZFsbmmi8hquDRVj-w7wGqLbD3xOl9FjWWqfR1BAox1LBCrPSQIm7iKLxXG0_GvXaxqgP7ju5MsnCZqu4E0vjZaHq7X9QbDGZVVGaZHdjbfzv2eI Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:10:51.541038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6749f998c37a43428eb7e1233408c560", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6749f998c37a43428eb7e1233408c560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 01f1499bbf89441dae30433aaf1d29a7 Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:10:51.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Cannot 'detach_volume' instance 6d0e643e-dad7-4451-abce-e4481f372f3d while it is in vm_state rescued Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'server_id': '6d0e643e-dad7-4451-abce-e4481f372f3d', 'id': 'b7978d22-bd07-4a59-9277-74dc06c96764'} Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d0e643e-dad7-4451-abce-e4481f372f3d in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:10:51.543437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6d0e643e-dad7-4451-abce-e4481f372f3d while it is in vm_state rescued Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6d0e643e-dad7-4451-abce-e4481f372f3d while it is in vm_state rescued Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:10:51.545672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Returning 409 to user: Cannot 'detach_volume' instance 6d0e643e-dad7-4451-abce-e4481f372f3d while it is in vm_state rescued {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:10:51.546970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-068434bc-2b25-465c-8a9a-dde1e5b5c695 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments/b7978d22-bd07-4a59-9277-74dc06c96764" status: 409 len: 152 microversion: 2.1 time: 0.139840 Sep 01 18:10:51.546970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 314/642] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:10:51 2022] DELETE /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments/b7978d22-bd07-4a59-9277-74dc06c96764 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 18:10:51.552218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:10:51.552848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:51.558906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.559383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.559832 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.560743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.561204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.561659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.812799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8ea5575a-a20a-4232-8674-288dd3da2317 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "POST /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.264506 Sep 01 18:10:51.816532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 329/643] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:10:51 2022] POST /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:10:51.821765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:51.822369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:51.829954 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.830419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.830846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.831533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:51.831977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:51.832423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:51.963690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:51.971886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d116c9c5-696c-4a54-a9f9-f125e9d2cf1d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1724 microversion: 2.1 time: 0.154049 Sep 01 18:10:51.972470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 315/644] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:51 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:52.994119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:52.994839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:53.003246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:53.004046 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:53.004800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:53.005958 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:53.006727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:53.007436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:53.141728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:53.150173 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ad516818-bcbf-48b5-b17e-7decdf7ea0c0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1724 microversion: 2.1 time: 0.160568 Sep 01 18:10:53.150808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 330/645] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:52 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:54.172032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:54.172777 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:54.179186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:54.179660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:54.180144 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:54.180925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:54.181401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:54.181816 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:54.313561 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:54.317125 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:10:54.322064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7621b45f-4546-4d07-9687-e36136b30682 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1724 microversion: 2.1 time: 0.154545 Sep 01 18:10:54.322622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 316/646] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:54 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:55.343559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:55.344159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:55.350795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:55.351283 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:55.351717 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:55.352502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:55.352954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:55.353369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:55.486881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:55.495052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8e5ad3f9-bff0-4b78-9b5d-359d89e01a21 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1724 microversion: 2.1 time: 0.155549 Sep 01 18:10:55.495615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 331/647] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:55 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:56.517126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:56.517732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:56.524404 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:56.524903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:56.525335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:56.526013 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:56.526461 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:56.526880 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:56.652665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:56.661682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a80567d7-390a-4718-9601-ebb60173a3f2 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1724 microversion: 2.1 time: 0.148855 Sep 01 18:10:56.662237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 317/648] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:56 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:57.682866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:57.683470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:57.690217 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:57.690694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:57.691126 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:57.691813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:57.692260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:57.692705 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:57.823405 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:57.835942 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a4224498-680a-4958-a31b-ece87feb90b6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1724 microversion: 2.1 time: 0.156231 Sep 01 18:10:57.838659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 332/649] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:57 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:10:58.857820 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:10:58.858413 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:10:58.864879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:58.865348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:58.865775 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:58.866450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:10:58.866893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:10:58.867307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:10:58.997824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:10:59.005848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-921dfc82-0077-4230-b74c-8ce9c0f0e25f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1724 microversion: 2.1 time: 0.152472 Sep 01 18:10:59.006401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 318/650] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:10:58 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:00.027286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:00.027932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:00.031009 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=39 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:00.036063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:00.043288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:00.043288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:00.043288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:00.043288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:00.043694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:00.165316 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:00.173481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-70fc884e-4e26-4308-b7aa-d8625106464b tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1730 microversion: 2.1 time: 0.150022 Sep 01 18:11:00.174049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 333/651] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:00 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:00.194627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:00.195181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:00.198804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:00.203369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:00.203369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:00.203644 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:00.204366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:00.204813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:00.217735 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:00.287147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2a5073d9-21d1-4006-a9bd-1d2bb35266ee tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096277 Sep 01 18:11:00.287776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 319/652] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:11:00 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:11:01.311373 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-54f336c9-8eff-4c51-9c65-504952a4c248 req-61ff8a10-fec7-4ec4-af8b-cded8cc4bc86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0e643e-dad7-4451-abce-e4481f372f3d", "tag": "5eeacdba-549e-4f16-9803-cf2a8f4e4adc"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:01.324936 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-54f336c9-8eff-4c51-9c65-504952a4c248 req-61ff8a10-fec7-4ec4-af8b-cded8cc4bc86 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:01.325460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-54f336c9-8eff-4c51-9c65-504952a4c248 req-61ff8a10-fec7-4ec4-af8b-cded8cc4bc86 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:01.325889 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-54f336c9-8eff-4c51-9c65-504952a4c248 req-61ff8a10-fec7-4ec4-af8b-cded8cc4bc86 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:01.346576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-54f336c9-8eff-4c51-9c65-504952a4c248 req-61ff8a10-fec7-4ec4-af8b-cded8cc4bc86 service nova] Creating event network-changed:5eeacdba-549e-4f16-9803-cf2a8f4e4adc for instance 6d0e643e-dad7-4451-abce-e4481f372f3d on hv-cinder-74915 Sep 01 18:11:01.351610 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-54f336c9-8eff-4c51-9c65-504952a4c248 req-61ff8a10-fec7-4ec4-af8b-cded8cc4bc86 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044748 Sep 01 18:11:01.352353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 334/653] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:03.372117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-d6b8cea4-c826-4278-aeec-aee321e825be req-1d4977df-91de-4e36-94a8-042b703a9de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d0e643e-dad7-4451-abce-e4481f372f3d", "tag": "5eeacdba-549e-4f16-9803-cf2a8f4e4adc"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:03.382063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-d6b8cea4-c826-4278-aeec-aee321e825be req-1d4977df-91de-4e36-94a8-042b703a9de8 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:03.382533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-d6b8cea4-c826-4278-aeec-aee321e825be req-1d4977df-91de-4e36-94a8-042b703a9de8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:03.382961 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-d6b8cea4-c826-4278-aeec-aee321e825be req-1d4977df-91de-4e36-94a8-042b703a9de8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:03.394105 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-d6b8cea4-c826-4278-aeec-aee321e825be req-1d4977df-91de-4e36-94a8-042b703a9de8 service nova] Creating event network-changed:5eeacdba-549e-4f16-9803-cf2a8f4e4adc for instance 6d0e643e-dad7-4451-abce-e4481f372f3d on hv-cinder-74915 Sep 01 18:11:03.399109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-d6b8cea4-c826-4278-aeec-aee321e825be req-1d4977df-91de-4e36-94a8-042b703a9de8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031638 Sep 01 18:11:03.399859 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 320/654] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:08.073242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:08.073820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:08.080707 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:08.081208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:08.081621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:08.082300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:08.082755 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:08.083175 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:08.110578 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:11:08.516161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ae62ef40-7597-4540-b7a6-da388f282559 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 204 len: 0 microversion: 2.1 time: 0.613194 Sep 01 18:11:08.516801 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 335/655] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:11:07 2022] DELETE /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:11:08.525442 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:08.526138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:08.533597 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:08.534071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:08.534810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:08.535484 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:08.535929 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:08.536382 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:08.671249 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:08.679114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-262f7334-443b-4dd4-99f5-160210ec13b3 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1580 microversion: 2.1 time: 0.157828 Sep 01 18:11:08.679676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 321/656] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:08 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:09.702339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:09.703024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:09.709368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:09.709899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:09.710346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:09.711035 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:09.711478 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:09.711910 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:09.843573 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:09.851677 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bd9b9d96-8f2b-45cf-a1cb-cd10605e4fb0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1580 microversion: 2.1 time: 0.154476 Sep 01 18:11:09.852276 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 336/657] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:09 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:11:10.873567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:10.874307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:10.881724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:10.882194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:10.882687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:10.883444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:10.883963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:10.884441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:11.176302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:11.183696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f5b7d5b9-9c55-4376-833b-6032747d7dcc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1580 microversion: 2.1 time: 0.314191 Sep 01 18:11:11.184301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 322/658] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:10 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1580 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:11.850748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-ed4a0443-3050-4ee8-b206-e6c9b44a8fd2 req-90c5a218-8a1b-4880-bb9d-10c027072d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3334a42-c76b-45d7-871a-fe716b049f47", "name": "network-vif-deleted", "tag": "60e68c0d-feea-4cb7-86a6-dc2ab48b6f93"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:11.861121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ed4a0443-3050-4ee8-b206-e6c9b44a8fd2 req-90c5a218-8a1b-4880-bb9d-10c027072d53 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:11.861595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ed4a0443-3050-4ee8-b206-e6c9b44a8fd2 req-90c5a218-8a1b-4880-bb9d-10c027072d53 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:11.862017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ed4a0443-3050-4ee8-b206-e6c9b44a8fd2 req-90c5a218-8a1b-4880-bb9d-10c027072d53 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:11.873235 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-ed4a0443-3050-4ee8-b206-e6c9b44a8fd2 req-90c5a218-8a1b-4880-bb9d-10c027072d53 service nova] Creating event network-vif-deleted:60e68c0d-feea-4cb7-86a6-dc2ab48b6f93 for instance e3334a42-c76b-45d7-871a-fe716b049f47 on hv-cinder-74915 Sep 01 18:11:11.878119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-ed4a0443-3050-4ee8-b206-e6c9b44a8fd2 req-90c5a218-8a1b-4880-bb9d-10c027072d53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037028 Sep 01 18:11:11.878660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 337/659] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:12.204910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:12.207786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:12.214126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:12.214788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:12.215914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:12.221460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:12.223074 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:12.223747 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:12.317257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:12.327440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f6a2a523-e1ff-4e62-919a-3d260eca4796 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1226 microversion: 2.1 time: 0.126244 Sep 01 18:11:12.328100 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 323/660] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:12 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:13.351710 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:13.352506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:13.360342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:13.360881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:13.361325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:13.362031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:13.362477 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:13.362941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:13.397888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:13.398367 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:13.398799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:13.399235 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lazy-loading 'fault' on Instance uuid e3334a42-c76b-45d7-871a-fe716b049f47 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:11:13.442788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:13.450740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-26e4690d-f09a-4dfb-8124-fbf3f3f5202c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 200 len: 1231 microversion: 2.1 time: 0.104062 Sep 01 18:11:13.451291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 338/661] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:13 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:14.471097 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:14.471699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:14.478142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:14.478616 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:14.479044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:14.479725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:14.480172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:14.480636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:14.495516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] HTTP exception thrown: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Request method failure captured: Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 HTTP/1.1 Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPR5GS1enotP7czfLyuHDaXbJqEWcFvtDm12MlOW0r33O1o8mH677DHQ8LiFNqG4NnzbKmyYZkds2hq7uu9kVcxohcBcGUIzLot3wTDKmllqU_iEJa6MDWXxWuJnkBFN-ittR7Sv2vgjyZTV-MMT2s2R1oPOq05rDJk6T6YK5O9sbcs Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:11:14.500883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ca8eec30c0b4a659620b6f45bb94db9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-TestVolumeBootPattern-361507241 Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 14bd04e951254ec5bc29999bceeea214 Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:11:14.502509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'e3334a42-c76b-45d7-871a-fe716b049f47'} Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:11:14.503560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:11:14.505152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:14.506534 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Returning 404 to user: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:11:14.506534 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ae3f1003-d750-42a8-ae99-7a9eefb6770d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 404 len: 111 microversion: 2.1 time: 0.031875 Sep 01 18:11:14.506534 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 324/662] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:14 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:11:14.594869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1464606032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1874762970", "security_groups": [{"name": "tempest-secgroup-smoke-1538754185"}], "block_device_mapping_v2": [{"uuid": "ad197817-3a02-4d33-a3c5-83ad6db243b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b81e98a-02f9-4baf-b5a3-9da306ffc4e2"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:14.706673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] validate_networks() for [('2b81e98a-02f9-4baf-b5a3-9da306ffc4e2', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:11:15.267335 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:11:15.267782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:11:15.268250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:11:15.268675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:11:15.269099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:11:15.278438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:15.278992 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:15.279400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:15.280152 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:15.280639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:15.281064 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:15.298576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:11:15.302483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for user 14bd04e951254ec5bc29999bceeea214 and project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:11:15.358521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:11:15.360743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad197817-3a02-4d33-a3c5-83ad6db243b9',volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:11:15.896250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-543ffba9-7dbd-4ca0-97ce-4d551404fcd4 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.305443 Sep 01 18:11:15.896966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 339/663] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:11:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:11:15.908451 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7ebc7d5f-a507-4fbf-8c35-17eafe78d6ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:15.909056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7ebc7d5f-a507-4fbf-8c35-17eafe78d6ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:15.962700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7ebc7d5f-a507-4fbf-8c35-17eafe78d6ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:15.969542 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7ebc7d5f-a507-4fbf-8c35-17eafe78d6ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1095 microversion: 2.1 time: 0.064880 Sep 01 18:11:15.970275 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 325/664] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:15 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:16.989623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:16.990251 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:16.996221 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:16.996729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:16.997163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:16.997843 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:16.998290 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:16.998704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:17.061107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:17.068741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9951b86d-1dc6-4ed5-8d1a-99d8d65ddf9b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1145 microversion: 2.1 time: 0.083434 Sep 01 18:11:17.069302 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 340/665] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:16 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:18.089923 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:18.090712 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:18.097859 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:18.098943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:18.099377 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:18.100110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:18.100586 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:18.101014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:18.173506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:18.181507 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6e4528eb-942d-4fa4-bf46-c4959dc5b231 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1201 microversion: 2.1 time: 0.095440 Sep 01 18:11:18.182071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 326/666] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:18 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:19.207141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:19.208078 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:19.216641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:19.216641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:19.216836 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:19.217433 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:19.218010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:19.218437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:19.379003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:19.387179 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-893a781c-ff75-48db-85af-7605699d0938 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1279 microversion: 2.1 time: 0.183934 Sep 01 18:11:19.390015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 341/667] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:19 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:19.996497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-96fddc86-422b-48bb-ada0-5cdabb8ba8a0 req-d3d4f3b4-cdef-421c-91be-d1254bda07bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6059fd67-fbd2-436e-9ee1-83a607d32316", "tag": "a83e70aa-4123-44e1-b5e4-9dae2ea589ec"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:20.007106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-96fddc86-422b-48bb-ada0-5cdabb8ba8a0 req-d3d4f3b4-cdef-421c-91be-d1254bda07bf service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:20.007581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-96fddc86-422b-48bb-ada0-5cdabb8ba8a0 req-d3d4f3b4-cdef-421c-91be-d1254bda07bf service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:20.008006 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-96fddc86-422b-48bb-ada0-5cdabb8ba8a0 req-d3d4f3b4-cdef-421c-91be-d1254bda07bf service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:20.020366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-96fddc86-422b-48bb-ada0-5cdabb8ba8a0 req-d3d4f3b4-cdef-421c-91be-d1254bda07bf service nova] Creating event network-changed:a83e70aa-4123-44e1-b5e4-9dae2ea589ec for instance 6059fd67-fbd2-436e-9ee1-83a607d32316 on hv-cinder-74915 Sep 01 18:11:20.025356 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-96fddc86-422b-48bb-ada0-5cdabb8ba8a0 req-d3d4f3b4-cdef-421c-91be-d1254bda07bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032461 Sep 01 18:11:20.026196 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 327/668] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:20.410475 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:20.411058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:20.421795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:20.421795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:20.421795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:20.421795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:20.422286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:20.422286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:20.552457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:20.560763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b03ec49b-063b-48c7-8f85-f002090d7ef2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.154359 Sep 01 18:11:20.561330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 342/669] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:20 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:21.589452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:21.590974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:21.597127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:21.597601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:21.598030 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:21.598716 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:21.599160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:21.599578 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:21.730185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:21.738057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-87edcb28-c459-4d09-9d7d-6905924ca283 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.153379 Sep 01 18:11:21.738615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 328/670] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:21 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:22.758521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:22.759130 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:22.765474 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:22.765949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:22.766376 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:22.767049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:22.767495 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:22.767912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:22.771850 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:22.900012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:22.908160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-24affa73-90a7-4a50-a4b9-cdffd0a0b8ee tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.153458 Sep 01 18:11:22.908752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 343/671] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:22 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:23.929202 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:23.929812 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:23.936770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:23.937244 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:23.937667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:23.938341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:23.938783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:23.939198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:24.068353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:24.076184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bb6c6aa3-a077-40f9-8186-316a58922a91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.150810 Sep 01 18:11:24.076781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 329/672] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:23 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:25.096952 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:25.097559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:25.104058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:25.104565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:25.105000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:25.106391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:25.106930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:25.107359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:25.233883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:25.241624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7307149a-3262-45cf-8c2d-2a2afb0356a6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.148522 Sep 01 18:11:25.242197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 344/673] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:25 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:11:26.263103 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:26.263708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:26.266212 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:26.275131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:26.275131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:26.275131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:26.275131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:26.275504 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:26.275504 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:26.401082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:26.409748 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-055d6c5c-a60b-44d0-b067-03209c63a81c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.150441 Sep 01 18:11:26.410312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 330/674] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:26 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:27.436890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:27.437488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:27.439320 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:27.439971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:27.445192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:27.445670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:27.446094 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:27.446773 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:27.447215 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:27.447630 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:27.579862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:27.587540 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a05ced63-6da1-4cd5-8816-33c5d0c7a489 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.155721 Sep 01 18:11:27.588103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 345/675] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:27 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:11:28.609379 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:28.609990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:28.616326 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:28.616812 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:28.617235 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:28.617920 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:28.618366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:28.618889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:28.623274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=65 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:28.757914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:28.766683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-840691e3-7568-4f48-9b9d-49d9b7e8822d tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.161067 Sep 01 18:11:28.767271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 331/676] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:28 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:29.787874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:29.788535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:29.794479 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:29.796560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:29.796560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:29.796560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:29.796859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:29.797177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:29.926184 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:29.933513 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b25ec931-df48-42bf-8a1b-5a0d22345061 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.149906 Sep 01 18:11:29.934081 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 346/677] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:29 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:30.844741 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-554db537-c381-48c7-9c1f-f8f19d173d67 req-01ed102e-021a-4f1b-9e51-e1e35a709925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6059fd67-fbd2-436e-9ee1-83a607d32316", "name": "network-vif-plugged", "status": "completed", "tag": "a83e70aa-4123-44e1-b5e4-9dae2ea589ec"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:30.855925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-554db537-c381-48c7-9c1f-f8f19d173d67 req-01ed102e-021a-4f1b-9e51-e1e35a709925 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:30.856426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-554db537-c381-48c7-9c1f-f8f19d173d67 req-01ed102e-021a-4f1b-9e51-e1e35a709925 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:30.856851 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-554db537-c381-48c7-9c1f-f8f19d173d67 req-01ed102e-021a-4f1b-9e51-e1e35a709925 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:30.870267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-554db537-c381-48c7-9c1f-f8f19d173d67 req-01ed102e-021a-4f1b-9e51-e1e35a709925 service nova] Creating event network-vif-plugged:a83e70aa-4123-44e1-b5e4-9dae2ea589ec for instance 6059fd67-fbd2-436e-9ee1-83a607d32316 on hv-cinder-74915 Sep 01 18:11:30.875719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-554db537-c381-48c7-9c1f-f8f19d173d67 req-01ed102e-021a-4f1b-9e51-e1e35a709925 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034782 Sep 01 18:11:30.876396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 332/678] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:30.954257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:30.954862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:30.957202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:30.962061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:30.962539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:30.962997 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:30.963683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:30.964128 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:30.964578 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:31.098606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:31.106159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d6ea948d-0436-41f5-ad9d-34ee0dbfdd5c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.156086 Sep 01 18:11:31.106746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 347/679] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:30 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:32.128187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:32.128898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:32.134961 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:32.135433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:32.135857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:32.136563 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:32.137009 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:32.137424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:32.266470 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:32.274115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c7f3ed7f-b381-49b6-9f48-5a726b6fb6c9 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1267 microversion: 2.1 time: 0.150880 Sep 01 18:11:32.274667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 333/680] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:32 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:33.294638 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:33.295989 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:33.302964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:33.303445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:33.303878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:33.304591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:33.305046 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:33.305468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:33.439818 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:33.447533 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8c17872c-ae6b-4d85-bc17-c166e31ea3d7 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1454 microversion: 2.1 time: 0.156774 Sep 01 18:11:33.448102 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 348/681] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:33 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:33.467763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:33.468420 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:33.470819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=32 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:33.475536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:33.476014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:33.476480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:33.477173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:33.477653 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:33.478070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:33.609756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:33.617542 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c246e65c-0cae-4254-b569-b52525aca112 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1454 microversion: 2.1 time: 0.154338 Sep 01 18:11:33.618114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 334/682] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:11:33 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:35.287481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:35.288034 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:35.294646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:35.296264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:35.296904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:35.297639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:35.298088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:35.298506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:35.328245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c286c409-d724-4b01-92e7-a32580eaab97 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments/00d8055a-70b3-4c10-8493-2f6f6e671133" status: 200 len: 194 microversion: 2.20 time: 0.045040 Sep 01 18:11:35.328862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 349/683] 10.222.0.15 () {60 vars in 1454 bytes} [Thu Sep 1 18:11:35 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments/00d8055a-70b3-4c10-8493-2f6f6e671133 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:11:35.398127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:35.398682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:35.405570 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:35.406038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:35.406463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:35.407140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:35.407582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:35.407993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:35.492020 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lazy-loading 'services' on Instance uuid f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:11:35.616782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-9c05576b-2eb6-42db-8e94-363a354a555b req-a4c16f41-ae10-44ed-adf7-60af1fb68656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6059fd67-fbd2-436e-9ee1-83a607d32316", "tag": "a83e70aa-4123-44e1-b5e4-9dae2ea589ec"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:35.626174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9c05576b-2eb6-42db-8e94-363a354a555b req-a4c16f41-ae10-44ed-adf7-60af1fb68656 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:35.626760 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9c05576b-2eb6-42db-8e94-363a354a555b req-a4c16f41-ae10-44ed-adf7-60af1fb68656 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:35.627289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9c05576b-2eb6-42db-8e94-363a354a555b req-a4c16f41-ae10-44ed-adf7-60af1fb68656 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:35.638616 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-9c05576b-2eb6-42db-8e94-363a354a555b req-a4c16f41-ae10-44ed-adf7-60af1fb68656 service nova] Creating event network-changed:a83e70aa-4123-44e1-b5e4-9dae2ea589ec for instance 6059fd67-fbd2-436e-9ee1-83a607d32316 on hv-cinder-74915 Sep 01 18:11:35.651569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-9c05576b-2eb6-42db-8e94-363a354a555b req-a4c16f41-ae10-44ed-adf7-60af1fb68656 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030707 Sep 01 18:11:35.651569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 350/684] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:11:35.808834 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e228efcd-6ec9-47ce-badf-a1fb89e3f76e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments/00d8055a-70b3-4c10-8493-2f6f6e671133" status: 202 len: 0 microversion: 2.20 time: 0.414157 Sep 01 18:11:35.817912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 335/685] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Sep 1 18:11:35 2022] DELETE /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments/00d8055a-70b3-4c10-8493-2f6f6e671133 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:11:35.822779 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:35.825920 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:35.833825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:35.834580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:35.835236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:35.836149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:35.836823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:35.837550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:35.877312 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0930e8c8-df7d-43d1-ad33-b01c2f3222fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060502 Sep 01 18:11:35.877888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 351/686] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 1 18:11:35 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:11:36.890738 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:36.893091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:36.900189 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:36.900338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:36.900893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:36.901583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:36.902023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:36.902438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:36.933941 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5c539c08-450a-4a1e-91fb-e7a9a822d5fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047918 Sep 01 18:11:36.934789 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 336/687] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 1 18:11:36 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:11:37.946503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:37.948698 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:37.955710 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:37.956178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:37.956632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:37.957304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:37.957751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:37.958187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:37.986578 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fe7d03f7-0603-46b5-808b-9ff40ca4af61 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044095 Sep 01 18:11:37.987121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 352/688] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 1 18:11:37 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:11:38.047122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:38.047619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:38.053862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:38.054331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:38.054756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:38.055429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:38.055898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:38.056325 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:38.084243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:11:38.379324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-77b501f0-6663-4935-8997-fae16f94bb01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 204 len: 0 microversion: 2.20 time: 0.336202 Sep 01 18:11:38.379901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 337/689] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 1 18:11:38 2022] DELETE /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 18:11:38.388397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:38.389303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:38.399888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:38.399888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:38.399888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:38.399888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:38.400279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:38.400279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:38.524046 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:38.532645 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:38.534083 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:38.535489 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b2e02c13-79a0-4781-be0f-5b754a7190b2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.151077 Sep 01 18:11:38.536043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 353/690] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:38 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:39.559010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:39.559657 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:39.566243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:39.566717 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:39.567148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:39.567824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:39.568273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:39.568719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:39.698927 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:39.707675 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:39.709145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:39.710302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-732ae9ef-3285-4cfc-99a2-0cfd263624cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.155648 Sep 01 18:11:39.710887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 338/691] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:39 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:40.734237 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:40.734947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:40.741416 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:40.741895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:40.742327 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:40.743018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:40.743464 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:40.743930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:40.882001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:40.890197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:40.891631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:40.892826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4829b02e-8743-45f1-ac1c-0fb3aaa2a7ee tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1723 microversion: 2.20 time: 0.163117 Sep 01 18:11:40.893377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 354/692] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:40 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:41.255794 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-c75c4737-9d65-464f-9f63-58ff1bfb629d req-2527e78c-7800-4756-88af-024905153a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47", "name": "network-vif-deleted", "tag": "2f84538c-e0cf-462c-ba99-07996763dee1"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:41.266338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c75c4737-9d65-464f-9f63-58ff1bfb629d req-2527e78c-7800-4756-88af-024905153a4e service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:41.267646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c75c4737-9d65-464f-9f63-58ff1bfb629d req-2527e78c-7800-4756-88af-024905153a4e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:41.268074 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c75c4737-9d65-464f-9f63-58ff1bfb629d req-2527e78c-7800-4756-88af-024905153a4e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:41.279914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-c75c4737-9d65-464f-9f63-58ff1bfb629d req-2527e78c-7800-4756-88af-024905153a4e service nova] Creating event network-vif-deleted:2f84538c-e0cf-462c-ba99-07996763dee1 for instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 on hv-cinder-74915 Sep 01 18:11:41.285797 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-c75c4737-9d65-464f-9f63-58ff1bfb629d req-2527e78c-7800-4756-88af-024905153a4e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Sep 01 18:11:41.286398 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 339/693] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:41.915264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:41.915870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:41.922456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:41.922932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:41.923360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:41.924041 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:41.924516 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:41.924934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:41.956280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:41.956580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:41.957013 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:41.957440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lazy-loading 'fault' on Instance uuid f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:11:41.998092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:42.006817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:42.008433 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:42.009693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-89cb9317-e8b6-45eb-b44b-ed76c26417a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 200 len: 1371 microversion: 2.20 time: 0.098347 Sep 01 18:11:42.010329 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 355/694] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:41 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:43.033310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:43.033997 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:43.040898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:43.041378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:43.041818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:43.042505 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:43.042953 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:43.043372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:43.056446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] HTTP exception thrown: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Request method failure captured: Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 HTTP/1.1 Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQPMjlnbScpzWjczEDLUhmziXYzO-BOb8yJi47DS2irRsqgM5xrQ02Q5CBmqOSx6Qrp08SkSCpBLynwPyR4eXEetoqtCTgUm0SNiCSnNb0MyIFGfp1PEs3Vxy8Pjim9dPg85X3cBEsaOInodK59ogycPjNyezn59CA1szqO6OvJtOE Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: b40443d415fa40338b837dd445032342 Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:11:43.058040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b40443d415fa40338b837dd445032342", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b40443d415fa40338b837dd445032342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: b40443d415fa40338b837dd445032342 Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: fb6a740de8b9417b89afb08f230aa4b7 Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:11:43.059698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47'} Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:11:43.061368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:11:43.062898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:11:43.064220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Returning 404 to user: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:11:43.064220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a09c9645-6a55-43ec-86f1-12aaa9995797 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 404 len: 111 microversion: 2.20 time: 0.030362 Sep 01 18:11:43.064220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 340/695] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:43 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:11:43.069107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b4c20d52-565e-4225-8161-90d4b4c319e1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '.version_select at 0x7f446a79bb80>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:43.163227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b4c20d52-565e-4225-8161-90d4b4c319e1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735506503" status: 204 len: 0 microversion: 2.20 time: 0.097817 Sep 01 18:11:43.163816 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 356/696] 10.222.0.15 () {60 vars in 1262 bytes} [Thu Sep 1 18:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1735506503 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 18:11:44.195087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5d83e075-d490-41a7-b7dd-d4ab83e239ba tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'create', calling method: .version_select at 0x7f446a8d2b80>, body: {"keypair": {"name": "tempest-keypair-2062790780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7mVBPc0IHYOrAt1Tm87xTU0SQEp/P3G/SPRI5wuA9JnpXJstd7I1M+TXcLHfx8x/OplKxTLPxRuc3YA79g8E56pjWV+A9VZMZBJfvXGmBtwDIBsXqcuQyBj+b0ZZDU3w=="}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:44.210846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-5d83e075-d490-41a7-b7dd-d4ab83e239ba tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for project b40443d415fa40338b837dd445032342. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:11:44.214606 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-5d83e075-d490-41a7-b7dd-d4ab83e239ba tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for user fb6a740de8b9417b89afb08f230aa4b7 and project b40443d415fa40338b837dd445032342. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:11:44.369388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5d83e075-d490-41a7-b7dd-d4ab83e239ba tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.178134 Sep 01 18:11:44.369908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 341/697] 10.222.0.15 () {62 vars in 1200 bytes} [Thu Sep 1 18:11:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 18:11:46.668873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2126483117", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b0ca8af-c9fa-4c03-8352-34ec8782c36f"}], "security_groups": [{"name": "tempest-securitygroup--621203328"}], "key_name": "tempest-keypair-2062790780", "user_data": "}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:46.771561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] validate_networks() for [('4b0ca8af-c9fa-4c03-8352-34ec8782c36f', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:11:47.133265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:11:47.133686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:11:47.134156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:11:47.134561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:11:47.134973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:11:47.144263 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:47.144766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:47.145263 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:47.145921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:47.146369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:47.146791 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:47.164212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for project b40443d415fa40338b837dd445032342. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:11:47.168124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Getting quotas for user fb6a740de8b9417b89afb08f230aa4b7 and project b40443d415fa40338b837dd445032342. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:11:47.178938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:11:47.181225 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:11:47.381958 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b273102a-f013-4f78-807f-49d34b09e55e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.717935 Sep 01 18:11:47.382521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 357/698] 10.222.0.15 () {62 vars in 1188 bytes} [Thu Sep 1 18:11:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 18:11:47.394957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e4a2d09d-0cf0-497a-b52f-07f190c8d354 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:47.395559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e4a2d09d-0cf0-497a-b52f-07f190c8d354 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:47.450363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e4a2d09d-0cf0-497a-b52f-07f190c8d354 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:47.460584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e4a2d09d-0cf0-497a-b52f-07f190c8d354 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:47.462101 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e4a2d09d-0cf0-497a-b52f-07f190c8d354 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:47.463207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e4a2d09d-0cf0-497a-b52f-07f190c8d354 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1282 microversion: 2.20 time: 0.072967 Sep 01 18:11:47.463760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 342/699] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:47 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:48.486691 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:48.490236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:48.493745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:48.494124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:48.494553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:48.495233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:48.495741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:48.496142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:48.561804 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:48.569843 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:48.571285 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:48.572402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aaaec8c6-82d1-4a60-b9e6-77358f3be2b5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1286 microversion: 2.20 time: 0.091717 Sep 01 18:11:48.573794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 358/700] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:48 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:49.596019 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:49.596646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:49.603666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:49.604147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:49.604691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:49.605389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:49.605886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:49.606308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:49.691368 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:49.700563 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:49.703438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:49.704939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d36a3e47-cc67-4bda-ba6a-11dee8d01028 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1342 microversion: 2.20 time: 0.113718 Sep 01 18:11:49.712385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 343/701] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:49 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1342 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:50.727298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:50.727831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:50.734886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:50.736087 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:50.736087 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:50.736695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:50.737147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:50.737761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:50.875117 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:50.883137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:50.884606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:50.885714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1c38efe3-0690-47e6-a834-445bd443e63e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.162514 Sep 01 18:11:50.886273 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 359/702] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:50 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:51.334135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-cd4fa565-ac08-46e3-802e-3218687d0af5 req-ae1aac9c-a59b-4f49-9ad3-39039e9aa155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b934582-1b3c-402f-88a5-4d3ebd9b402b", "tag": "ee5cfce4-3d6f-4b56-8883-1152c0054962"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:51.343849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cd4fa565-ac08-46e3-802e-3218687d0af5 req-ae1aac9c-a59b-4f49-9ad3-39039e9aa155 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:51.344342 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cd4fa565-ac08-46e3-802e-3218687d0af5 req-ae1aac9c-a59b-4f49-9ad3-39039e9aa155 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:51.344778 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cd4fa565-ac08-46e3-802e-3218687d0af5 req-ae1aac9c-a59b-4f49-9ad3-39039e9aa155 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:51.355484 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-cd4fa565-ac08-46e3-802e-3218687d0af5 req-ae1aac9c-a59b-4f49-9ad3-39039e9aa155 service nova] Creating event network-changed:ee5cfce4-3d6f-4b56-8883-1152c0054962 for instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b on hv-cinder-74915 Sep 01 18:11:51.360764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-cd4fa565-ac08-46e3-802e-3218687d0af5 req-ae1aac9c-a59b-4f49-9ad3-39039e9aa155 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030445 Sep 01 18:11:51.361339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 344/703] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:51.910268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:51.910867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:51.917325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:51.917807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:51.918241 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:51.918930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:51.920162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:51.920617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:52.055425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:52.063546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:52.064925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:52.066023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5e9b276b-5007-49f4-8d8d-71fc4f2aa9f2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.160033 Sep 01 18:11:52.066576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 360/704] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:51 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:53.089313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:53.089973 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:53.097193 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:53.097891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:53.098570 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:53.099438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:53.100044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:53.100661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:53.232684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:53.241550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:53.243022 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:53.244138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-33b15f21-3d0e-4758-92bc-44efb828206b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.159659 Sep 01 18:11:53.244730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 345/705] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:53 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:11:54.266132 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:54.266731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:54.273144 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:54.273621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:54.274049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:54.274731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:54.275172 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:54.275586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:54.278214 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=96 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:54.401055 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:54.410433 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:54.412091 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:54.413224 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-560e56b9-77ce-41b0-a056-b6246f44d30a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.151129 Sep 01 18:11:54.413778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 361/706] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:54 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:55.437231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:55.437830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:55.444222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:55.444734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:55.445160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:55.445840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:55.446280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:55.446697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:55.586825 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:55.599664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:55.601343 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:55.602528 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dd265537-7310-4e83-8610-f7929403a8c3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.169794 Sep 01 18:11:55.604624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 346/707] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:55 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:56.626288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:56.626927 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:56.633375 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:56.633855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:56.634288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:56.634971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:56.635422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:56.635842 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:56.769039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:56.777065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:56.778565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:56.780066 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f7d5db51-fd1f-482a-8883-ae884af227d8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.158332 Sep 01 18:11:56.780681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 362/708] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:56 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:57.803237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:57.803765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:57.806209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:57.811694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:57.813840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:57.813840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:57.813840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:57.813840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:57.814213 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:57.943342 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:57.951346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:57.952824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:57.953921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-574bfe64-903e-4a7e-a5c1-aea84c13daea tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.154645 Sep 01 18:11:57.954472 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 347/709] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:57 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:11:58.943912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-947c29f4-2fa3-45be-8649-41b68d59dd4d req-6a981a3b-3dc5-446c-be02-2bafd015531e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b934582-1b3c-402f-88a5-4d3ebd9b402b", "name": "network-vif-plugged", "status": "completed", "tag": "ee5cfce4-3d6f-4b56-8883-1152c0054962"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:11:58.948963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:58.949626 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:58.955536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-947c29f4-2fa3-45be-8649-41b68d59dd4d req-6a981a3b-3dc5-446c-be02-2bafd015531e service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:58.956082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-947c29f4-2fa3-45be-8649-41b68d59dd4d req-6a981a3b-3dc5-446c-be02-2bafd015531e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:58.956482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-947c29f4-2fa3-45be-8649-41b68d59dd4d req-6a981a3b-3dc5-446c-be02-2bafd015531e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:58.967503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-947c29f4-2fa3-45be-8649-41b68d59dd4d req-6a981a3b-3dc5-446c-be02-2bafd015531e service nova] Creating event network-vif-plugged:ee5cfce4-3d6f-4b56-8883-1152c0054962 for instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b on hv-cinder-74915 Sep 01 18:11:58.972692 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-947c29f4-2fa3-45be-8649-41b68d59dd4d req-6a981a3b-3dc5-446c-be02-2bafd015531e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032624 Sep 01 18:11:58.973282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 363/710] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:11:58.976537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:11:58.980904 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:11:58.984088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:58.984602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:58.985041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:58.985737 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:11:58.986184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:11:58.986649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:11:58.990715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:11:59.117847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:59.127184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:59.130112 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:11:59.130112 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7dfd7d7c-7759-4ad8-a187-04434c9c6708 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.157423 Sep 01 18:11:59.130393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 348/711] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:11:58 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:12:00.154375 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:00.155063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:00.162075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:00.162551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:00.162982 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:00.163689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:00.164140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:00.164583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:00.295770 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:00.303803 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:00.305265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:00.306366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e2e82352-71a1-49e2-aa78-6614b40570fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.157093 Sep 01 18:12:00.306922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 364/712] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:12:00 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:12:01.330068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:01.330793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:01.337672 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:01.338143 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:01.338580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:01.339270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:01.339722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:01.340147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:01.474357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:01.482337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:01.483757 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:01.484887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7cc372d5-9c76-4eb0-8bc4-ce3287ade8c2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1407 microversion: 2.20 time: 0.159725 Sep 01 18:12:01.485480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 349/713] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:12:01 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:12:02.507160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:02.507691 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:02.514291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:02.514766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:02.515196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:02.515875 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:02.516340 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:02.516758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:02.642783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:02.650721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:02.652182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:02.653855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1f846955-6454-4446-a9a7-8dce0554f29d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1599 microversion: 2.20 time: 0.150196 Sep 01 18:12:02.654407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 365/714] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:12:02 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:12:02.676328 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:02.676830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:02.683140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:02.683614 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:02.684048 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:02.684797 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:02.685243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:02.685657 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:02.760479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-acaec662-ec26-4bf2-8f08-7c4cbce92030 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088244 Sep 01 18:12:02.761102 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 350/715] 10.222.0.15 () {60 vars in 1316 bytes} [Thu Sep 1 18:12:02 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:12:04.024142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-262a7b81-d41b-4737-b823-3d60c47d52be req-48e1f036-9e46-46b1-82c0-e09494ae64fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b934582-1b3c-402f-88a5-4d3ebd9b402b", "tag": "ee5cfce4-3d6f-4b56-8883-1152c0054962"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:04.030599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:04.037638 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-262a7b81-d41b-4737-b823-3d60c47d52be req-48e1f036-9e46-46b1-82c0-e09494ae64fa service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:04.038514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-262a7b81-d41b-4737-b823-3d60c47d52be req-48e1f036-9e46-46b1-82c0-e09494ae64fa service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:04.039283 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-262a7b81-d41b-4737-b823-3d60c47d52be req-48e1f036-9e46-46b1-82c0-e09494ae64fa service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:04.052622 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-262a7b81-d41b-4737-b823-3d60c47d52be req-48e1f036-9e46-46b1-82c0-e09494ae64fa service nova] Creating event network-changed:ee5cfce4-3d6f-4b56-8883-1152c0054962 for instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b on hv-cinder-74915 Sep 01 18:12:04.058036 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-262a7b81-d41b-4737-b823-3d60c47d52be req-48e1f036-9e46-46b1-82c0-e09494ae64fa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037638 Sep 01 18:12:04.058656 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 366/716] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:12:05.997377 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:05.997918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:05.999706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:06.004417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:06.004903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:06.005338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:06.006078 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:06.006530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:06.006955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:06.087773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lazy-loading 'services' on Instance uuid 6d0e643e-dad7-4451-abce-e4481f372f3d {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:12:06.378696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cac69d74-a31c-4f90-88c5-adc967767caf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments/b7978d22-bd07-4a59-9277-74dc06c96764" status: 202 len: 0 microversion: 2.1 time: 0.385454 Sep 01 18:12:06.379292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 351/717] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:12:05 2022] DELETE /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments/b7978d22-bd07-4a59-9277-74dc06c96764 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:12:06.389875 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:06.392143 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:06.398743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:06.399214 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:06.399694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:06.400408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:06.400850 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:06.401265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:06.430194 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-05c0145f-c92d-4227-a45e-b83b2cc0f53a tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Sep 01 18:12:06.430744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 367/718] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:12:06 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:12:07.443760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:07.446088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:07.453154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:07.453624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:07.454047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:07.454721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:07.455162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:07.455573 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:07.487932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-069ce546-9995-43ce-925e-69dc7973bfe5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048430 Sep 01 18:12:07.488426 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 352/719] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:12:07 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:12:08.500492 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:08.502643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:08.509434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:08.509854 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:08.510283 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:08.510973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:08.511424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:08.511842 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:08.540880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5a5a9eda-2866-4edd-b39c-df1d95e6b4aa tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044685 Sep 01 18:12:08.541434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 368/720] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:12:08 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:12:08.619961 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:08.620539 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:08.627029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:08.627497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:08.627918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:08.628622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:08.629065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:08.629514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:08.654374 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:12:08.973155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d8c5364b-d807-4761-8a7a-8252ac1135bf tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 204 len: 0 microversion: 2.1 time: 0.356724 Sep 01 18:12:08.973888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 353/721] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:12:08 2022] DELETE /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:12:08.981918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:08.982524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:08.988701 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:08.989179 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:08.989613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:08.990293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:08.990744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:08.991163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:09.121140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:09.129583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-deef7f25-49ea-4b20-b732-547ef372d9a3 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1690 microversion: 2.1 time: 0.151596 Sep 01 18:12:09.130148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 369/722] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:08 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:10.151508 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:10.152230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:10.159611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:10.160363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:10.160799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:10.161480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:10.161928 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:10.162346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:10.291406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:10.299203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5f04ceab-2f30-4c19-8db2-c63ece1cdda9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1690 microversion: 2.1 time: 0.151943 Sep 01 18:12:10.299766 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 354/723] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:10 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:11.320061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:11.320725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:11.327233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:11.327713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:11.328153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:11.328867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:11.329320 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:11.329742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:11.461540 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:11.469739 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b1b0ba79-3873-4841-94a4-a98cb7829b76 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1690 microversion: 2.1 time: 0.153554 Sep 01 18:12:11.470306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 370/724] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:11 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:12.492265 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:12.492726 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:12.499844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:12.500351 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:12.500785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:12.501473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:12.501936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:12.502327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:12.542929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-9e7c1a0a-c6b7-40f8-8277-54a0e7704872 req-591b7855-3d90-4ca5-9dd4-c7280fdb46a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d0e643e-dad7-4451-abce-e4481f372f3d", "name": "network-vif-deleted", "tag": "5eeacdba-549e-4f16-9803-cf2a8f4e4adc"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:12.554462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9e7c1a0a-c6b7-40f8-8277-54a0e7704872 req-591b7855-3d90-4ca5-9dd4-c7280fdb46a7 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:12.555428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9e7c1a0a-c6b7-40f8-8277-54a0e7704872 req-591b7855-3d90-4ca5-9dd4-c7280fdb46a7 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:12.556065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9e7c1a0a-c6b7-40f8-8277-54a0e7704872 req-591b7855-3d90-4ca5-9dd4-c7280fdb46a7 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:12.569687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:12.570668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-9e7c1a0a-c6b7-40f8-8277-54a0e7704872 req-591b7855-3d90-4ca5-9dd4-c7280fdb46a7 service nova] Creating event network-vif-deleted:5eeacdba-549e-4f16-9803-cf2a8f4e4adc for instance 6d0e643e-dad7-4451-abce-e4481f372f3d on hv-cinder-74915 Sep 01 18:12:12.575870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-9e7c1a0a-c6b7-40f8-8277-54a0e7704872 req-591b7855-3d90-4ca5-9dd4-c7280fdb46a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036603 Sep 01 18:12:12.576942 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 371/725] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:12:12.578974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9f1e8e50-4e63-4d13-b5ea-b73555171db8 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1622 microversion: 2.1 time: 0.091621 Sep 01 18:12:12.579530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 355/726] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:12 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:13.605236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:13.605236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:13.607201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:13.607677 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:13.608109 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:13.608830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:13.609283 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:13.609705 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:13.645139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:13.645618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:13.646072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:13.646522 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lazy-loading 'fault' on Instance uuid 6d0e643e-dad7-4451-abce-e4481f372f3d {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:12:13.691669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:13.700158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-59bd94e2-b07b-487d-9698-60118f91ced0 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 200 len: 1336 microversion: 2.1 time: 0.104167 Sep 01 18:12:13.700813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 372/727] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:13 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:14.722181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:14.722763 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: 6d0e643e-dad7-4451-abce-e4481f372f3d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:14.729407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:14.729817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:14.730240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:14.731529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:14.731976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:14.732419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:14.745416 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] HTTP exception thrown: Instance 6d0e643e-dad7-4451-abce-e4481f372f3d could not be found. Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Request method failure captured: Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d HTTP/1.1 Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQRvIYMjYUKZZPjSLJWG0HYMhOZB6twqfznx3zIOmiPYq3_YozI0xfIaj3eQibvZFsbmmi8hquDRVj-w7wGqLbD3xOl9FjWWqfR1BAox1LBCrPSQIm7iKLxXG0_GvXaxqgP7ju5MsnCZqu4E0vjZaHq7X9QbDGZVVGaZHdjbfzv2eI Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:12:14.747269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6749f998c37a43428eb7e1233408c560", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6749f998c37a43428eb7e1233408c560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 01f1499bbf89441dae30433aaf1d29a7 Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 6d0e643e-dad7-4451-abce-e4481f372f3d could not be found. Sep 01 18:12:14.748938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '6d0e643e-dad7-4451-abce-e4481f372f3d'} Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d0e643e-dad7-4451-abce-e4481f372f3d could not be found. Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:12:14.749770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d0e643e-dad7-4451-abce-e4481f372f3d could not be found. Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d0e643e-dad7-4451-abce-e4481f372f3d could not be found. Sep 01 18:12:14.751262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:14.752713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Returning 404 to user: Instance 6d0e643e-dad7-4451-abce-e4481f372f3d could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:12:14.752713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a209b831-3a1f-4135-a658-967247250f19 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d" status: 404 len: 111 microversion: 2.1 time: 0.030375 Sep 01 18:12:14.752713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 356/728] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:14 2022] GET /compute/v2.1/servers/6d0e643e-dad7-4451-abce-e4481f372f3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:12:14.757069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-122f03b2-db7e-4d98-8d73-a088127c0ed9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '.version_select at 0x7f446a80cf70>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:14.825048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-122f03b2-db7e-4d98-8d73-a088127c0ed9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280764308" status: 202 len: 0 microversion: 2.1 time: 0.071072 Sep 01 18:12:14.825630 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 373/729] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 1 18:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280764308 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 18:12:18.125028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:18.125532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:18.131921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:18.132434 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:18.132868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:18.133553 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:18.134000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:18.134424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:18.159670 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:12:18.482366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0f20c6d1-ad38-479c-bd75-38611187b274 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "DELETE /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 204 len: 0 microversion: 2.1 time: 0.361564 Sep 01 18:12:18.483173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 357/730] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:12:18 2022] DELETE /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:12:18.491720 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:18.492342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:18.499640 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:18.500155 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:18.500624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:18.501300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:18.501746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:18.502160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:18.628200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:18.635892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9d5b0fe2-917d-4539-a5ce-fd8c079ee21f tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1509 microversion: 2.1 time: 0.148682 Sep 01 18:12:18.636484 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 374/731] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:18 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:19.656866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:19.657580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:19.664566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:19.665055 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:19.665490 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:19.666179 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:19.666644 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:19.667047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:19.864074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-3918f275-4424-430a-ae2f-33ceaeb29c62 req-c33f67d5-a5e2-401a-abeb-09a1d299457e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5937468-debf-4941-8ccb-0809386abf2d", "name": "network-vif-deleted", "tag": "7058a1c8-0e4d-4bb2-b86e-133b7c35bf09"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:19.875947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3918f275-4424-430a-ae2f-33ceaeb29c62 req-c33f67d5-a5e2-401a-abeb-09a1d299457e service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:19.876941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3918f275-4424-430a-ae2f-33ceaeb29c62 req-c33f67d5-a5e2-401a-abeb-09a1d299457e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:19.877527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3918f275-4424-430a-ae2f-33ceaeb29c62 req-c33f67d5-a5e2-401a-abeb-09a1d299457e service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:19.888897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:19.891618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-3918f275-4424-430a-ae2f-33ceaeb29c62 req-c33f67d5-a5e2-401a-abeb-09a1d299457e service nova] Creating event network-vif-deleted:7058a1c8-0e4d-4bb2-b86e-133b7c35bf09 for instance b5937468-debf-4941-8ccb-0809386abf2d on hv-cinder-74915 Sep 01 18:12:19.897683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-3918f275-4424-430a-ae2f-33ceaeb29c62 req-c33f67d5-a5e2-401a-abeb-09a1d299457e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037915 Sep 01 18:12:19.897994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b013afe8-a29c-4967-9d99-e4ad4a1164a6 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 200 len: 1509 microversion: 2.1 time: 0.245900 Sep 01 18:12:19.904139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 375/732] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:12:19.904689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 358/733] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:19 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:20.921683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:20.922369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: b5937468-debf-4941-8ccb-0809386abf2d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:20.929004 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:20.929485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:20.929918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:20.930663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:20.931119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:20.931677 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:20.945971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] HTTP exception thrown: Instance b5937468-debf-4941-8ccb-0809386abf2d could not be found. Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Request method failure captured: Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d HTTP/1.1 Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQRvIYMjYUKZZPjSLJWG0HYMhOZB6twqfznx3zIOmiPYq3_YozI0xfIaj3eQibvZFsbmmi8hquDRVj-w7wGqLbD3xOl9FjWWqfR1BAox1LBCrPSQIm7iKLxXG0_GvXaxqgP7ju5MsnCZqu4E0vjZaHq7X9QbDGZVVGaZHdjbfzv2eI Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:12:20.947641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6749f998c37a43428eb7e1233408c560", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6749f998c37a43428eb7e1233408c560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 01f1499bbf89441dae30433aaf1d29a7 Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance b5937468-debf-4941-8ccb-0809386abf2d could not be found. Sep 01 18:12:20.949208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'b5937468-debf-4941-8ccb-0809386abf2d'} Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5937468-debf-4941-8ccb-0809386abf2d could not be found. Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:12:20.950381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5937468-debf-4941-8ccb-0809386abf2d could not be found. Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5937468-debf-4941-8ccb-0809386abf2d could not be found. Sep 01 18:12:20.951613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:12:20.953099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Returning 404 to user: Instance b5937468-debf-4941-8ccb-0809386abf2d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:12:20.953099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9c6c3368-bb1d-4d89-bff7-e262a3213383 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d" status: 404 len: 111 microversion: 2.1 time: 0.032492 Sep 01 18:12:20.953099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 376/734] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:20 2022] GET /compute/v2.1/servers/b5937468-debf-4941-8ccb-0809386abf2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:12:20.957582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:20.958054 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:20.964550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:20.965107 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:20.965521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:20.966276 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:20.966743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:20.967143 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:20.992687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:12:21.322707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-76485940-ccc1-4438-b805-aba725c5c7da tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 204 len: 0 microversion: 2.1 time: 0.368243 Sep 01 18:12:21.323287 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 359/735] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:12:20 2022] DELETE /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:12:21.331415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:21.332020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:21.338129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:21.338598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:21.339020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:21.341643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:21.341643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:21.341643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:21.474060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:21.478740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-46d5931f-66c4-413d-a352-b2a797aee88d tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1521 microversion: 2.1 time: 0.151077 Sep 01 18:12:21.479359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 377/736] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:21 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:22.502001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:22.502698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:22.509065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:22.509541 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:22.509969 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:22.510648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:22.511091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:22.511511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:22.515576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:22.580085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:22.588222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ab7d0ac5-4766-467e-b65c-7d14b19539f9 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1479 microversion: 2.1 time: 0.090342 Sep 01 18:12:22.600342 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 360/737] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:22 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1479 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:22.665587 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-2e5f9dca-6a30-4a99-8154-91d504238dc5 req-65e26cea-02bb-4607-8f4d-5321dcef3f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4f11d5-97c7-4f32-86bd-71967d45e5ed", "name": "network-vif-deleted", "tag": "ed8a669c-c810-4434-b401-01f61d9036c1"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:22.676640 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2e5f9dca-6a30-4a99-8154-91d504238dc5 req-65e26cea-02bb-4607-8f4d-5321dcef3f3f service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:22.677341 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2e5f9dca-6a30-4a99-8154-91d504238dc5 req-65e26cea-02bb-4607-8f4d-5321dcef3f3f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:22.677774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2e5f9dca-6a30-4a99-8154-91d504238dc5 req-65e26cea-02bb-4607-8f4d-5321dcef3f3f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:22.690104 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-2e5f9dca-6a30-4a99-8154-91d504238dc5 req-65e26cea-02bb-4607-8f4d-5321dcef3f3f service nova] Creating event network-vif-deleted:ed8a669c-c810-4434-b401-01f61d9036c1 for instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed on hv-cinder-74915 Sep 01 18:12:22.695126 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-2e5f9dca-6a30-4a99-8154-91d504238dc5 req-65e26cea-02bb-4607-8f4d-5321dcef3f3f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 Sep 01 18:12:22.695756 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 378/738] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:12:23.308253 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:23.312931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:23.314778 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:23.315237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:23.315660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:23.316354 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:23.316800 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:23.317211 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:23.339551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lazy-loading 'flavor' on Instance uuid e6f510cd-8ecf-4e9d-a60f-97277d17b97c {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:12:23.611655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:23.612392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:23.618500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:23.618987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:23.619413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:23.620102 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:23.620574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:23.621531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:23.652632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:23.653111 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:23.653542 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:23.653985 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lazy-loading 'fault' on Instance uuid bf4f11d5-97c7-4f32-86bd-71967d45e5ed {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:12:23.697206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f1499bbf89441dae30433aaf1d29a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6749f998c37a43428eb7e1233408c560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:23.706002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-02b72d3e-a27e-4285-a4a2-041037bd98d5 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 200 len: 1311 microversion: 2.1 time: 0.098479 Sep 01 18:12:23.706558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 379/739] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:23 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:23.727871 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-736e2edd-067d-4d4f-b0ef-ceb2710bb2c7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "POST /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c/action" status: 202 len: 0 microversion: 2.1 time: 0.663661 Sep 01 18:12:23.728473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 361/740] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:12:23 2022] POST /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:12:23.737158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:23.737770 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:23.744183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:23.744697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:23.745295 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:23.746574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:23.747032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:23.747448 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:23.893337 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:23.900978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e071f768-5e11-4655-b01f-5b0950a8a7a0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.167675 Sep 01 18:12:23.901583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 380/741] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:23 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:24.728064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:24.728778 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] [instance: bf4f11d5-97c7-4f32-86bd-71967d45e5ed] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:24.736395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:24.736876 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:24.737302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:24.738008 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:24.738454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:24.738868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:24.751984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] HTTP exception thrown: Instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed could not be found. Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Request method failure captured: Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed HTTP/1.1 Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQRvIYMjYUKZZPjSLJWG0HYMhOZB6twqfznx3zIOmiPYq3_YozI0xfIaj3eQibvZFsbmmi8hquDRVj-w7wGqLbD3xOl9FjWWqfR1BAox1LBCrPSQIm7iKLxXG0_GvXaxqgP7ju5MsnCZqu4E0vjZaHq7X9QbDGZVVGaZHdjbfzv2eI Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:12:24.753585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6749f998c37a43428eb7e1233408c560", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6749f998c37a43428eb7e1233408c560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6749f998c37a43428eb7e1233408c560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 6749f998c37a43428eb7e1233408c560 Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1731710918 Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 01f1499bbf89441dae30433aaf1d29a7 Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1731710918-project Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed could not be found. Sep 01 18:12:24.755194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'bf4f11d5-97c7-4f32-86bd-71967d45e5ed'} Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed could not be found. Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:12:24.756106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed could not be found. Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed could not be found. Sep 01 18:12:24.757811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:12:24.759197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] Returning 404 to user: Instance bf4f11d5-97c7-4f32-86bd-71967d45e5ed could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:12:24.759197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2436705a-0c4d-4aaa-bb86-6fa17cc27159 tempest-ServerRescueNegativeTestJSON-1731710918 tempest-ServerRescueNegativeTestJSON-1731710918-project] 10.222.0.15 "GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed" status: 404 len: 111 microversion: 2.1 time: 0.031133 Sep 01 18:12:24.759197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 362/742] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:24 2022] GET /compute/v2.1/servers/bf4f11d5-97c7-4f32-86bd-71967d45e5ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:12:24.922318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:24.922935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:24.929354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:24.929837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:24.930268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:24.930960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:24.931402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:24.931823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:24.936470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=94 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:25.176231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:25.185111 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ec322606-bc45-4335-904e-33ad56c3c32c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.266557 Sep 01 18:12:25.185771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 381/743] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:24 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:26.207313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:26.207861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:26.216516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:26.217000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:26.217430 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:26.218129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:26.218579 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:26.219006 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:26.354478 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:26.362117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cae88b8f-ca8c-4b75-84cd-9340aff68701 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.159598 Sep 01 18:12:26.362709 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 363/744] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:26 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:27.383052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:27.384396 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:27.391806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:27.392564 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:27.392992 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:27.393682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:27.394125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:27.394546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:27.530583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:27.538604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b0d708d9-7080-453a-8989-83c0121e2d9d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.159495 Sep 01 18:12:27.539159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 382/745] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:27 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:28.560330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:28.561061 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:28.567367 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:28.568058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:28.568518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:28.569215 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:28.569667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:28.570280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:28.799255 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:28.807013 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fac0e7ee-b26e-4c1c-a314-db419d710441 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.250770 Sep 01 18:12:28.807552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 364/746] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:28 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:29.828618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:29.829456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:29.843663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:29.843663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:29.843663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:29.843663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:29.844075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:29.844075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:29.975735 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:29.985525 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7d201231-2433-459a-a923-788703da32ab tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.160052 Sep 01 18:12:29.986208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 383/747] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:29 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:31.007110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:31.007906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:31.015116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:31.015592 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:31.016021 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:31.016870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:31.017313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:31.024226 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:31.175252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:31.183069 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3c198144-510b-43ae-8200-b39a8bcf6dd3 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.179855 Sep 01 18:12:31.184136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 365/748] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:31 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:32.205256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:32.205755 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:32.217557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:32.217557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:32.217557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:32.217557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:32.218002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:32.218002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:32.360566 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:32.368531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-08a9c649-1124-4994-99f2-15ce4da6d783 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.167205 Sep 01 18:12:32.369187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 384/749] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:32 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:33.390846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:33.391453 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:33.397783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:33.398262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:33.398690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:33.399384 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:33.399835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:33.400258 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:33.584491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:33.592597 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7ddee02c-402d-43c6-8d6b-136f7396a6ae tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.206177 Sep 01 18:12:33.593173 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 366/750] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:33 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:34.614969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:34.615653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:34.622441 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:34.623054 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:34.623691 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:34.624416 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:34.625025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:34.625480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:34.773093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:34.782033 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fb9977c1-5f8b-451e-a037-b29df3617a7a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.171031 Sep 01 18:12:34.782825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 385/751] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:34 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:35.804880 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:35.805485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:35.812671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:35.813357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:35.814197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:35.815073 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:35.815518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:35.816024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:35.993948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:36.007487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e1541ad4-0516-4d86-948c-73e5757524b7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.201874 Sep 01 18:12:36.007487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 367/752] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:35 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:36.676244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-df9f778c-3a0f-4b4d-959c-9f243a9f555f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'create', calling method: .version_select at 0x7f446a756ca0>, body: {"keypair": {"name": "tempest-keypair-1993609111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkNz2YT7t3dOWGM6dgLNuJ2RMQunnifNF+1S7V0cQ+YvMyf/i8IYlfK+1YQBm8F7iI1m7AZRLioxHMc7xC4h+61rOnKE0V1ljVUldupj1SecH+DCONoF7QJuvAvv5gRLg=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:36.692699 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-df9f778c-3a0f-4b4d-959c-9f243a9f555f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for project 1c789d40f8a84058a49533d382fe5303. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:12:36.696734 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-df9f778c-3a0f-4b4d-959c-9f243a9f555f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for user f747a57b1a604347b9d2828bdddfa0e9 and project 1c789d40f8a84058a49533d382fe5303. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:12:36.803170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-df9f778c-3a0f-4b4d-959c-9f243a9f555f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.249373 Sep 01 18:12:36.803929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 386/753] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:12:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:12:37.023029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:37.023747 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:37.026209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:37.031190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:37.031678 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:37.032108 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:37.032827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:37.033330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:37.033936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:37.170474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:37.176389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-10a09ffd-5e55-4746-aa2a-667d02304596 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.157242 Sep 01 18:12:37.176948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 368/754] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:37 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:38.197380 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:38.198929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:38.205453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:38.206201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:38.206629 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:38.207318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:38.207771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:38.208222 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:38.411468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:38.420901 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4c595a7a-ac64-43a6-83a2-993082076430 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.227382 Sep 01 18:12:38.421986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 387/755] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:38 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:39.449201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:39.450223 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:39.459175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:39.459840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:39.460480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:39.461424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:39.462026 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:39.462598 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:39.723040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:39.735655 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1d589228-ab5e-4b79-afbc-554a5ab651f4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.295073 Sep 01 18:12:39.737292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 369/756] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:39 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:39.760937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-524253504", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc156a6a-c1da-4b16-9e79-62956f265b52"}], "security_groups": [{"name": "tempest-securitygroup--1355135771"}], "key_name": "tempest-keypair-1993609111", "user_data": "}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:39.770464 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:39.871255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] validate_networks() for [('dc156a6a-c1da-4b16-9e79-62956f265b52', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:12:40.264003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:12:40.264431 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:12:40.264926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:12:40.265331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:12:40.265734 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:12:40.274449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:40.274914 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:40.275342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:40.276062 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:40.277031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:40.277445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:40.294126 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for project 1c789d40f8a84058a49533d382fe5303. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:12:40.297988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for user f747a57b1a604347b9d2828bdddfa0e9 and project 1c789d40f8a84058a49533d382fe5303. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:12:40.308789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:12:40.311029 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:12:40.517269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6bd5bae7-581d-4a92-9d84-6b20176fc535 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.760532 Sep 01 18:12:40.517829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 388/757] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:12:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:12:40.529663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-917cc3d1-1bda-4683-a4f8-e1b19e2bcf08 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:40.530396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-917cc3d1-1bda-4683-a4f8-e1b19e2bcf08 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:40.583816 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-917cc3d1-1bda-4683-a4f8-e1b19e2bcf08 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:40.591291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-917cc3d1-1bda-4683-a4f8-e1b19e2bcf08 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1237 microversion: 2.1 time: 0.066563 Sep 01 18:12:40.591854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 370/758] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:40 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:40.763379 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:40.763987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:40.770105 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:40.770526 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:40.770958 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:40.771644 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:40.772092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:40.772543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:40.908938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:40.918059 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-25ff8380-0181-49af-8116-1a4385313ba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.158969 Sep 01 18:12:40.918678 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 389/759] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:40 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:41.611853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c97b09f8-e17f-4cfc-9c0e-4c0fd194502f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:41.612501 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c97b09f8-e17f-4cfc-9c0e-4c0fd194502f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:41.670123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c97b09f8-e17f-4cfc-9c0e-4c0fd194502f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:41.677857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c97b09f8-e17f-4cfc-9c0e-4c0fd194502f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1237 microversion: 2.1 time: 0.069859 Sep 01 18:12:41.678600 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 371/760] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:41 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:41.939348 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:41.939866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:41.946427 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:41.946873 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:41.947305 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:41.947998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:41.948524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:41.949014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:42.086632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:42.095045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fcd3458a-66ce-4f8e-95fe-3cc3985b84ec tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.159661 Sep 01 18:12:42.095615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 390/761] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:41 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:42.699746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:42.700363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:42.706682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:42.707148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:42.707602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:42.708291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:42.708746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:42.709190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:42.774692 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:42.783015 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-067b6f89-2ce2-4fa7-8a13-ae5b0e19283c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1289 microversion: 2.1 time: 0.087396 Sep 01 18:12:42.783419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 372/762] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:42 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:43.116230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:43.116867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:43.123874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.124402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.124838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.125523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.125972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.126393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.268890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:43.278154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6ae93ea0-a721-4d27-b0fe-4d8ed6563a6b tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1571 microversion: 2.1 time: 0.165710 Sep 01 18:12:43.278806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 391/763] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:43 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:43.300048 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:43.300911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:43.306760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.310731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.310731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.310731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.310731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.311106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.339996 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121220) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 18:12:43.774786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a04c9f07-ddc6-4dea-9f57-eabf14cab94d tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "POST /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c/action" status: 202 len: 0 microversion: 2.1 time: 0.478596 Sep 01 18:12:43.776062 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 373/764] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:12:43 2022] POST /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:12:43.784828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:43.785693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:43.791827 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.792557 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.793058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.793754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.794222 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.794667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.805093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:43.805692 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:43.812031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.812544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.813033 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.813740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:43.814190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:43.814616 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:43.898004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:43.906960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2725beab-a1c8-4930-b522-d8250d71656d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1295 microversion: 2.1 time: 0.105583 Sep 01 18:12:43.916848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 374/765] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:43 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:43.950570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:44.065397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-88618a6c-f6d3-4397-96c5-31e6d03967fa tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1519 microversion: 2.1 time: 0.284237 Sep 01 18:12:44.066454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 392/766] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:43 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1519 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:44.930518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:44.931722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:44.939174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:44.940017 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:44.940761 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:44.941774 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:44.942708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:44.943348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:45.024563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-b61324e9-91d2-4c69-8e37-b4df9b427615 req-fe379454-a526-4347-9365-82bc3345aa26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f510cd-8ecf-4e9d-a60f-97277d17b97c", "name": "network-vif-unplugged", "status": "completed", "tag": "2e2fab45-f892-4f70-bdce-c498f573098d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:45.038748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b61324e9-91d2-4c69-8e37-b4df9b427615 req-fe379454-a526-4347-9365-82bc3345aa26 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:45.039257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b61324e9-91d2-4c69-8e37-b4df9b427615 req-fe379454-a526-4347-9365-82bc3345aa26 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:45.040383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b61324e9-91d2-4c69-8e37-b4df9b427615 req-fe379454-a526-4347-9365-82bc3345aa26 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:45.055074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.compute.server_external_events [req-b61324e9-91d2-4c69-8e37-b4df9b427615 req-fe379454-a526-4347-9365-82bc3345aa26 service nova] Unable to find a host for instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c. Dropping event network-vif-unplugged {{(pid=121221) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 18:12:45.056205 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-b61324e9-91d2-4c69-8e37-b4df9b427615 req-fe379454-a526-4347-9365-82bc3345aa26 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037175 Sep 01 18:12:45.057159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 393/767] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 18:12:45.088154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:45.089368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:45.096252 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:45.096789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:45.097234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:45.097934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:45.098568 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:45.098996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:45.120528 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:45.130543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b9f0c1a1-337d-4ed6-a7ef-300ac9b1cbaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.204454 Sep 01 18:12:45.132283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 375/768] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:44 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:45.186120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-6dbfbee9-5b3e-4521-bf21-b4300d4705b3 req-5f7d5bfc-f405-4b21-8b08-9a651905aea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cce0d3b-3280-47a3-a0f1-f42481c397c1", "tag": "edb2da5c-9a4c-4600-85b0-5be3d2a1f983"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:45.196568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-6dbfbee9-5b3e-4521-bf21-b4300d4705b3 req-5f7d5bfc-f405-4b21-8b08-9a651905aea7 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:45.197039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-6dbfbee9-5b3e-4521-bf21-b4300d4705b3 req-5f7d5bfc-f405-4b21-8b08-9a651905aea7 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:45.197776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-6dbfbee9-5b3e-4521-bf21-b4300d4705b3 req-5f7d5bfc-f405-4b21-8b08-9a651905aea7 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:45.211128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-6dbfbee9-5b3e-4521-bf21-b4300d4705b3 req-5f7d5bfc-f405-4b21-8b08-9a651905aea7 service nova] Creating event network-changed:edb2da5c-9a4c-4600-85b0-5be3d2a1f983 for instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 on hv-cinder-74915 Sep 01 18:12:45.223154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-6dbfbee9-5b3e-4521-bf21-b4300d4705b3 req-5f7d5bfc-f405-4b21-8b08-9a651905aea7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040713 Sep 01 18:12:45.223992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 376/769] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:12:45.257210 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:45.266580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-01713af8-8522-4bd1-bba0-cd4edf740ec4 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1519 microversion: 2.1 time: 0.182158 Sep 01 18:12:45.267207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 394/770] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:45 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:46.153690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:46.154971 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:46.161706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:46.162190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:46.162613 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:46.163397 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:46.164166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:46.164786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:46.170026 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:46.287907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:46.288467 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:46.296249 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:46.298224 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:46.298224 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:46.298224 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:46.298224 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:46.298833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:46.306137 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:46.313893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d2613615-7f56-4f8f-bc0a-88a95dbe2158 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.165389 Sep 01 18:12:46.314731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 377/771] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:46 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:46.428785 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:46.436874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6d452c80-bce4-48df-a187-015bc1c293d0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1521 microversion: 2.1 time: 0.153176 Sep 01 18:12:46.437437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 395/772] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:46 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:47.335137 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:47.335744 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:47.343433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:47.349731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:47.349731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:47.349731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:47.349731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:47.350129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:47.458278 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:47.459503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:47.466906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:47.467397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:47.467839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:47.469109 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:47.469620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:47.475664 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:47.477870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:47.485639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6e96036b-95d8-4da0-a49f-205998252ab1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.154411 Sep 01 18:12:47.486218 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 378/773] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:47 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:47.603029 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:47.610670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cb066709-93c3-4fce-80b6-deb8b3b75e63 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1521 microversion: 2.1 time: 0.156219 Sep 01 18:12:47.611230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 396/774] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:47 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:48.505690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:48.506221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:48.512766 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:48.513242 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:48.513673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:48.514357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:48.514810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:48.515234 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:48.635776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:48.636591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:48.640756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:48.643477 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:48.643946 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:48.644393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:48.655159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:48.655159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:48.655159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:48.655468 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0fe3c825-b21e-4bec-a978-dc584002a514 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.146730 Sep 01 18:12:48.655468 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 379/775] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:48 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:48.777422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:48.785443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-49cace9c-3bdc-42e6-8ff1-2a22276bc0c0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1521 microversion: 2.1 time: 0.153491 Sep 01 18:12:48.786013 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 397/776] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:48 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:49.669739 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:49.670372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:49.676825 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:49.677238 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:49.677664 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:49.678354 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:49.678803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:49.679221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:49.806983 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:49.808247 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:49.814965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:49.815523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:49.815964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:49.816684 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:49.817140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:49.817566 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:49.872345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:49.880262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-76dbfe2d-39ea-4bf4-9bca-eb06d32357eb tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.215087 Sep 01 18:12:49.881089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 380/777] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:49 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:49.956796 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:49.967757 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-08c3896f-35c3-4dd2-96f6-9c4a2455dee0 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.162947 Sep 01 18:12:49.967757 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 398/778] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:49 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:50.901959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:50.902706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:50.908904 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:50.909375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:50.909799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:50.910736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:50.911179 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:50.911592 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:50.990856 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:50.991452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:50.993548 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:50.994202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=10 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:50.999781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:51.000266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:51.000732 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:51.001418 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:51.001862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:51.002277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:51.053414 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:51.061583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b1fa847f-3b7f-49ed-806b-403bec7c052d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.164087 Sep 01 18:12:51.062805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 381/779] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:50 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:51.133824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:51.142078 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-64682565-e12b-472d-91f8-31568f05ea0a tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.155034 Sep 01 18:12:51.142660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 399/780] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:50 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:52.082224 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:52.082760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:52.084824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=4 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:52.089574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:52.090084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:52.090536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:52.091229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:52.091676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:52.092097 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:52.163512 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:52.164169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:52.171681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:52.172167 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:52.172637 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:52.173334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:52.173977 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:52.174190 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:52.176960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=100 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:12:52.226609 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:52.235127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d57e32f3-e89b-4726-99b2-934008dc35be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.156889 Sep 01 18:12:52.236349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 382/781] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:52 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:52.313104 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:52.320799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e93d1758-59de-49ba-804e-1986ce570fde tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.161371 Sep 01 18:12:52.321354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 400/782] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:52 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:53.251228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-e0c839f3-593d-4271-8f09-b2928bb14b2d req-471142d4-0afc-4f88-a057-c067490c2b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cce0d3b-3280-47a3-a0f1-f42481c397c1", "name": "network-vif-plugged", "status": "completed", "tag": "edb2da5c-9a4c-4600-85b0-5be3d2a1f983"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:53.259184 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:53.260211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:53.264999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-e0c839f3-593d-4271-8f09-b2928bb14b2d req-471142d4-0afc-4f88-a057-c067490c2b15 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:53.265469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-e0c839f3-593d-4271-8f09-b2928bb14b2d req-471142d4-0afc-4f88-a057-c067490c2b15 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:53.265893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-e0c839f3-593d-4271-8f09-b2928bb14b2d req-471142d4-0afc-4f88-a057-c067490c2b15 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:53.267418 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:53.267902 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:53.268362 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:53.269057 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:53.269667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:53.270090 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:53.277325 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-e0c839f3-593d-4271-8f09-b2928bb14b2d req-471142d4-0afc-4f88-a057-c067490c2b15 service nova] Creating event network-vif-plugged:edb2da5c-9a4c-4600-85b0-5be3d2a1f983 for instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 on hv-cinder-74915 Sep 01 18:12:53.282247 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-e0c839f3-593d-4271-8f09-b2928bb14b2d req-471142d4-0afc-4f88-a057-c067490c2b15 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035088 Sep 01 18:12:53.282861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 383/783] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:12:53.342394 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:53.343122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:53.349532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:53.350252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:53.350680 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:53.351545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:53.351995 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:53.352632 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:53.416192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:53.433136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-227174e3-75fb-435e-84ab-22d726baf9be tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.180246 Sep 01 18:12:53.434682 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 401/784] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:53 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:53.499715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:53.507731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4465025a-4955-4970-86d5-79bfdefe94cf tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.169604 Sep 01 18:12:53.508283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 384/785] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:53 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:54.453411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:54.453938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:54.460462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:54.460945 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:54.461383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:54.462074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:54.462526 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:54.462950 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:54.529863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:54.530491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:54.537594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:54.538075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:54.538505 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:54.539190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:54.540085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:54.540085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:54.591448 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:54.599303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a2e32b97-840f-4c10-b20d-802d31639a84 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.149802 Sep 01 18:12:54.599867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 402/786] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:54 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:54.669905 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:54.677786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cee6c4b9-cc0d-4138-b8f5-59ff7736f689 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.152563 Sep 01 18:12:54.678349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 385/787] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:54 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:55.620915 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:55.621656 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:55.627946 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:55.628454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:55.628882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:55.629554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:55.630097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:55.630514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:55.699184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:55.699796 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:55.706557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:55.707034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:55.707460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:55.708281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:55.708749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:55.709374 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:55.768027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:55.777799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8addc0f6-9799-46c4-87cb-6d5f1e2f2a50 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1363 microversion: 2.1 time: 0.161201 Sep 01 18:12:55.778634 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 403/788] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:55 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:55.862648 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:55.871598 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2ccd05df-ca6c-4b4a-92b6-3ab7cca185a9 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.176370 Sep 01 18:12:55.872172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 386/789] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:55 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:56.798921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:56.799519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:56.805921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:56.808460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:56.808460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:56.808460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:56.808460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:56.808822 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:56.892138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:56.892802 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:56.899228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:56.899711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:56.900140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:56.901710 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:56.902174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:56.902598 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:56.940938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:56.948912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7f8206c6-7e52-41f4-ba38-5afb80bdb569 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1549 microversion: 2.1 time: 0.153776 Sep 01 18:12:56.949487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 404/790] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:56 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:12:56.969551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:56.970040 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:56.975945 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:56.976461 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:56.976892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:56.977580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:56.978026 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:56.978445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:57.035668 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:57.044171 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-eff6c5c3-ce42-4dbb-83f2-c696b8669e93 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.156000 Sep 01 18:12:57.045105 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 387/791] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:56 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:57.055878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0a19c698-88ee-4d0f-bfa4-8f7c6e44ba11 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089989 Sep 01 18:12:57.056521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 405/792] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:12:56 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:12:58.066691 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:58.067392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:58.073519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:58.074087 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:58.074585 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:58.075556 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:58.076204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:58.077514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:58.124574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-c62e20ca-8caf-48ba-be61-c235921a5bed req-1af907d7-b90d-4568-a2e7-414f124696a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cce0d3b-3280-47a3-a0f1-f42481c397c1", "tag": "edb2da5c-9a4c-4600-85b0-5be3d2a1f983"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:12:58.134334 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c62e20ca-8caf-48ba-be61-c235921a5bed req-1af907d7-b90d-4568-a2e7-414f124696a5 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:58.134844 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c62e20ca-8caf-48ba-be61-c235921a5bed req-1af907d7-b90d-4568-a2e7-414f124696a5 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:58.135304 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c62e20ca-8caf-48ba-be61-c235921a5bed req-1af907d7-b90d-4568-a2e7-414f124696a5 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:58.148359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-c62e20ca-8caf-48ba-be61-c235921a5bed req-1af907d7-b90d-4568-a2e7-414f124696a5 service nova] Creating event network-changed:edb2da5c-9a4c-4600-85b0-5be3d2a1f983 for instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 on hv-cinder-74915 Sep 01 18:12:58.154221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-c62e20ca-8caf-48ba-be61-c235921a5bed req-1af907d7-b90d-4568-a2e7-414f124696a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095170 Sep 01 18:12:58.155047 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 388/793] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:12:58.230528 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:58.242918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5fdff2bc-f22e-4f1a-9a14-e084fe2e45ef tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.181011 Sep 01 18:12:58.243481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 406/794] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:58 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:12:59.265400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:12:59.266116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:12:59.272485 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:59.272967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:59.273395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:59.274096 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:12:59.274540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:12:59.274959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:12:59.408537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:12:59.416968 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8b241a35-9a2a-4582-9c97-0902abbb9543 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.156446 Sep 01 18:12:59.417535 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 389/795] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:12:59 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:00.437800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:00.438462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:00.444771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:00.445245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:00.445667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:00.446339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:00.446783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:00.447196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:00.578032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:00.585692 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ae76c223-c260-48bb-81e8-f2896fe78b68 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.151758 Sep 01 18:13:00.586254 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 407/796] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:00 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:01.153383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-a62cbdf5-0239-4a59-a2f1-8c10835a7c2c req-79ca4611-af1c-45a8-a1d9-50dff1d9fc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f510cd-8ecf-4e9d-a60f-97277d17b97c", "name": "network-vif-plugged", "status": "completed", "tag": "2e2fab45-f892-4f70-bdce-c498f573098d"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:13:01.163924 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-a62cbdf5-0239-4a59-a2f1-8c10835a7c2c req-79ca4611-af1c-45a8-a1d9-50dff1d9fc3f service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:01.164448 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-a62cbdf5-0239-4a59-a2f1-8c10835a7c2c req-79ca4611-af1c-45a8-a1d9-50dff1d9fc3f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:01.164875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-a62cbdf5-0239-4a59-a2f1-8c10835a7c2c req-79ca4611-af1c-45a8-a1d9-50dff1d9fc3f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:01.176407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-a62cbdf5-0239-4a59-a2f1-8c10835a7c2c req-79ca4611-af1c-45a8-a1d9-50dff1d9fc3f service nova] Creating event network-vif-plugged:2e2fab45-f892-4f70-bdce-c498f573098d for instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c on hv-cinder-74915 Sep 01 18:13:01.181135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-a62cbdf5-0239-4a59-a2f1-8c10835a7c2c req-79ca4611-af1c-45a8-a1d9-50dff1d9fc3f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031461 Sep 01 18:13:01.181717 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 390/797] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:13:01.607255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:01.608018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:01.614996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:01.615572 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:01.616077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:01.616878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:01.617329 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:01.617749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:01.747237 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:01.755016 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-68044a1a-b5fd-4bae-93ee-5743964a7963 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.152350 Sep 01 18:13:01.755580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 408/798] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:01 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:02.780214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:02.780940 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:02.787350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:02.787833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:02.788272 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:02.788982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:02.789437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:02.789862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:02.921256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:02.928997 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-da48064b-30bf-40f4-a656-6865ec8a78ac tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1577 microversion: 2.1 time: 0.154234 Sep 01 18:13:02.929561 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 391/799] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:02 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:03.950130 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:03.950714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:03.957076 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:03.957547 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:03.957971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:03.958649 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:03.959089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:03.959502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:04.091804 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:04.099462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ff8f6aa5-6d12-47bc-b8b5-e8bc7e6b86ee tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1564 microversion: 2.1 time: 0.153205 Sep 01 18:13:04.100021 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 409/800] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:03 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:30.522118 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:30.522649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:30.524694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:30.525346 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=77 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:30.530042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:30.530517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:30.534992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:30.534992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:30.534992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:30.534992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:30.556028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-425b6c9a-186e-4d07-ac44-ab5f27bcc89e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/ips" status: 200 len: 152 microversion: 2.20 time: 0.038028 Sep 01 18:13:30.556630 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 392/801] 10.222.0.15 () {60 vars in 1289 bytes} [Thu Sep 1 18:13:30 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:13:33.833012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:13:33.833601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:33.835657 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:33.836338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=57 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:33.841189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:33.841673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:33.842171 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:33.842795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:33.843245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:33.843724 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:33.866898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lazy-loading 'flavor' on Instance uuid 9b934582-1b3c-402f-88a5-4d3ebd9b402b {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:13:34.398288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f7c02a86-b74e-4335-80c5-b9e3d7e696aa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/action" status: 202 len: 0 microversion: 2.20 time: 0.569321 Sep 01 18:13:34.398913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 410/802] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 1 18:13:33 2022] POST /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 18:13:34.409431 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:34.410026 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:34.417411 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:34.417897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:34.418331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:34.419026 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:34.419475 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:34.419899 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:34.551954 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:34.559897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:34.561370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:34.562742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2e5eb1a1-bbe1-47fb-aa68-90818d096332 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.159351 Sep 01 18:13:34.563303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 393/803] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:34 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:13:35.588462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:35.589060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:35.599830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:35.600321 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:35.600755 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:35.601436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:35.601877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:35.602290 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:35.729761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:35.738561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:35.740001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:35.741180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6540dc80-07db-480f-85b0-0d0716163637 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.157652 Sep 01 18:13:35.741741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 411/804] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:35 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:36.763941 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:36.764580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:36.771115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:36.771585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:36.772018 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:36.772731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:36.773198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:36.773610 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:36.901671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:36.910083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:36.911770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:36.912959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-38f9f14e-3cdc-4d1e-ac9f-dbdfdcb0f11c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.152997 Sep 01 18:13:36.913513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 394/805] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:36 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:13:37.936202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:37.936852 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:37.943718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:37.944213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:37.944683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:37.945377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:37.945828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:37.946256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:38.078613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:38.086692 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:38.088129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:38.089313 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f095c38a-3456-4dae-81ae-a490ba8c827f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.157048 Sep 01 18:13:38.089872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 412/806] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:37 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:39.113210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:39.113814 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:39.120263 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:39.120693 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:39.121128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:39.121817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:39.122267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:39.122687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:39.260802 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:39.268815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:39.270236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:39.271405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3ccc2c98-5aaa-4318-a28a-a851b379d371 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.162710 Sep 01 18:13:39.271970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 395/807] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:39 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:40.294983 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:40.295580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:40.302707 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:40.303216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:40.303890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:40.305041 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:40.305796 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:40.306506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:40.438749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:40.446739 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:40.448188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:40.449381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e41a680c-643d-4020-bf0c-2faee365d6bd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.158246 Sep 01 18:13:40.449943 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 413/808] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:40 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:41.473448 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:41.474031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:41.479971 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:41.480497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:41.480931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:41.481626 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:41.482071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:41.482490 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:41.610991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:41.619144 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:41.620624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:41.621773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5c797d26-5643-4f3a-861f-f02a718c1b8d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.153627 Sep 01 18:13:41.622343 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 396/809] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:41 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:42.645024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:42.645640 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:42.652157 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:42.652663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:42.653096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:42.653780 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:42.654222 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:42.654640 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:42.789153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:42.797848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:42.799307 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:42.814923 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5e6eda36-ae63-42a4-b6c5-ba311034ad93 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.159406 Sep 01 18:13:42.814923 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 414/810] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:42 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:43.824502 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:43.825076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:43.831406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:43.831885 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:43.832331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:43.833295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:43.833825 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:43.834247 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:43.970134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:43.978335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:43.986124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:43.986124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-10f95752-677b-4fde-905e-cedf12dfbacd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.160550 Sep 01 18:13:43.986124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 397/811] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:43 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:45.006284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:45.006848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:45.013318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:45.013799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:45.014231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:45.014922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:45.015368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:45.015794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:45.144595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:45.152541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:45.153967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:45.155109 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-db54068c-1b32-4afb-bc73-f418cc71ae37 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.152879 Sep 01 18:13:45.155658 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 415/812] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:45 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:46.178064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:46.178705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:46.185430 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:46.185916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:46.186355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:46.187049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:46.188020 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:46.188477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:46.320932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:46.329812 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:46.331274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:46.332463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f82bed31-6782-4ed9-ae41-40a64789b1a8 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.158304 Sep 01 18:13:46.333024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 398/813] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:46 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:47.355284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:47.355888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:47.362636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:47.363115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:47.366465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:47.366465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:47.366465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:47.366465 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:47.496209 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:47.504621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:47.505978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:47.507115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-61169cc5-8ce8-4284-b347-b35023dea710 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.155888 Sep 01 18:13:47.507680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 416/814] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:47 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:48.530486 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:48.531026 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:48.538880 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:48.539358 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:48.539786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:48.540499 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:48.540971 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:48.541412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:48.718135 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:48.727683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:48.729187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:48.730379 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-51037e8b-9624-4851-b92b-9d27012c26a1 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.203934 Sep 01 18:13:48.730938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 399/815] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:48 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:49.753735 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:49.754346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:49.760768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:49.761239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:49.761661 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:49.762334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:49.762774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:49.763193 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:49.943932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:49.952016 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:49.953706 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:49.955299 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bd00b20c-cc14-4b23-99f0-99263788e652 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.206128 Sep 01 18:13:49.955854 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 417/816] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:49 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:50.977639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:50.980276 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:50.984616 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:50.985093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:50.985519 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:50.986695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:50.991959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:50.992449 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:51.076955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1363614772", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1874762970", "security_groups": [{"name": "tempest-secgroup-smoke-1538754185"}], "block_device_mapping_v2": [{"uuid": "b104063b-a6f7-4832-84c9-ef6505ac1fbe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b81e98a-02f9-4baf-b5a3-9da306ffc4e2"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:13:51.124392 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:51.134312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:51.135762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:51.136962 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fe12284b-6a5c-486d-b3d9-4e07ec846023 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.163199 Sep 01 18:13:51.137646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 400/817] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:50 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:13:51.195480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] validate_networks() for [('2b81e98a-02f9-4baf-b5a3-9da306ffc4e2', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:13:51.798503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:13:51.799051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:13:51.799544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:13:51.799979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:13:51.800420 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:13:51.809378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:51.818971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:51.818971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:51.818971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:51.818971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:51.819347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:51.828622 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:13:51.833339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Getting quotas for user 14bd04e951254ec5bc29999bceeea214 and project 3ca8eec30c0b4a659620b6f45bb94db9. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:13:51.889831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:13:51.892624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b104063b-a6f7-4832-84c9-ef6505ac1fbe',volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:13:52.160332 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:52.161246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:52.167191 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:52.167667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:52.168091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:52.168911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:52.169361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:52.169780 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:52.304750 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:52.312856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:52.314858 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:52.321182 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3f4e2382-60a1-4430-9954-86da212c40b3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1745 microversion: 2.20 time: 0.159949 Sep 01 18:13:52.321182 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 401/818] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:52 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:13:52.407238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ac28514c-8f9b-4852-8173-f73a0807d5e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.334013 Sep 01 18:13:52.408344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 418/819] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:13:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:13:52.419590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-afb85232-73d6-4808-ae60-7cf0a67d7656 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:52.420170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-afb85232-73d6-4808-ae60-7cf0a67d7656 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:52.477175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-afb85232-73d6-4808-ae60-7cf0a67d7656 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:52.487471 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-afb85232-73d6-4808-ae60-7cf0a67d7656 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1095 microversion: 2.1 time: 0.071802 Sep 01 18:13:52.488051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 402/820] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:52 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:53.341260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:53.342002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:53.350445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:53.350938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:53.355742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:53.355742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:53.355742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:53.355742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:53.482937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:53.491430 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:53.510519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:53.510519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e22b18c8-e447-4631-b799-991f50896932 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1745 microversion: 2.20 time: 0.157365 Sep 01 18:13:53.510519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 419/821] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:53 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:53.510901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b608311e-8caa-42ee-b72f-cae03d52bbda tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:53.510901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b608311e-8caa-42ee-b72f-cae03d52bbda tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:53.561999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b608311e-8caa-42ee-b72f-cae03d52bbda tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:53.570443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b608311e-8caa-42ee-b72f-cae03d52bbda tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1095 microversion: 2.1 time: 0.066228 Sep 01 18:13:53.571000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 403/822] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:53 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:13:54.525014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:54.525621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:54.532223 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:54.532731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:54.533162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:54.534366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:54.534813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:54.535233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:54.591005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:54.591615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:54.598612 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:54.599087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:54.599522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:54.600272 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:54.600746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:54.601167 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:54.666075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:54.674602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:54.675909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4aac74fd-a0c6-4b5b-8b28-7d6cbd3130c8 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1193 microversion: 2.1 time: 0.088785 Sep 01 18:13:54.680072 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 404/823] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:54 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:13:54.684034 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:54.685903 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:54.687305 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0d737a17-c225-45a3-a3fc-f5b129d69c81 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1745 microversion: 2.20 time: 0.166283 Sep 01 18:13:54.687959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 420/824] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:54 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:55.427295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-2d59c18f-8f8a-48fd-beb5-4672e1beb565 req-01ad3ec3-ea7e-432b-bf92-0eace4db66b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b934582-1b3c-402f-88a5-4d3ebd9b402b", "name": "network-vif-plugged", "status": "completed", "tag": "ee5cfce4-3d6f-4b56-8883-1152c0054962"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:13:55.436680 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d59c18f-8f8a-48fd-beb5-4672e1beb565 req-01ad3ec3-ea7e-432b-bf92-0eace4db66b8 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:55.437153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d59c18f-8f8a-48fd-beb5-4672e1beb565 req-01ad3ec3-ea7e-432b-bf92-0eace4db66b8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:55.437575 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d59c18f-8f8a-48fd-beb5-4672e1beb565 req-01ad3ec3-ea7e-432b-bf92-0eace4db66b8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:55.448833 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-2d59c18f-8f8a-48fd-beb5-4672e1beb565 req-01ad3ec3-ea7e-432b-bf92-0eace4db66b8 service nova] Creating event network-vif-plugged:ee5cfce4-3d6f-4b56-8883-1152c0054962 for instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b on hv-cinder-74915 Sep 01 18:13:55.453767 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-2d59c18f-8f8a-48fd-beb5-4672e1beb565 req-01ad3ec3-ea7e-432b-bf92-0eace4db66b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030970 Sep 01 18:13:55.454360 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 405/825] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:13:55.696786 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:55.697509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:55.703935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:55.706171 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:55.706171 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:55.706384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:55.706914 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:55.707342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:55.712698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:55.713388 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:55.720145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:55.720669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:55.721792 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:55.723297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:55.723297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:55.723500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:55.778271 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:55.786969 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f61df3e8-9e87-47a9-968d-126317764c44 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1201 microversion: 2.1 time: 0.094019 Sep 01 18:13:55.787536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 421/826] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:55 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:55.867678 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:55.873724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:55.875155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:55.876363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5fb0f01b-402a-4e2b-96d3-8999927a65cc tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1745 microversion: 2.20 time: 0.168406 Sep 01 18:13:55.876924 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 406/827] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:55 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:13:56.808618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:56.809364 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:56.817131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:56.817698 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:56.833384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:56.833384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:56.833384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:56.833384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:56.899820 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:56.900459 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:56.910040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:56.910959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:56.911461 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:56.912254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:56.912817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:56.913237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:56.967015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:56.975127 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4ea61ef4-ebc5-4eb7-848f-7815ba5e4174 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1279 microversion: 2.1 time: 0.170460 Sep 01 18:13:56.982314 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 422/828] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:56 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:57.048241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:57.056796 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:57.058221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:57.059400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-10b59042-0f55-49cd-98e1-8a3ab97bbac2 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1745 microversion: 2.20 time: 0.163641 Sep 01 18:13:57.059949 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 407/829] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:56 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:13:57.742122 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-951fb834-0f6a-453a-9c17-2eb845a218a1 req-5c7717a1-4780-49a5-a58e-63d9921cea56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f037dc-fe5b-4c8a-9e5d-faa28369c547", "tag": "f142999c-d83d-48ea-ba43-7dbe15c72c06"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:13:57.751786 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-951fb834-0f6a-453a-9c17-2eb845a218a1 req-5c7717a1-4780-49a5-a58e-63d9921cea56 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:57.752333 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-951fb834-0f6a-453a-9c17-2eb845a218a1 req-5c7717a1-4780-49a5-a58e-63d9921cea56 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:57.752770 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-951fb834-0f6a-453a-9c17-2eb845a218a1 req-5c7717a1-4780-49a5-a58e-63d9921cea56 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:57.764386 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-951fb834-0f6a-453a-9c17-2eb845a218a1 req-5c7717a1-4780-49a5-a58e-63d9921cea56 service nova] Creating event network-changed:f142999c-d83d-48ea-ba43-7dbe15c72c06 for instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 on hv-cinder-74915 Sep 01 18:13:57.769728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-951fb834-0f6a-453a-9c17-2eb845a218a1 req-5c7717a1-4780-49a5-a58e-63d9921cea56 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 Sep 01 18:13:57.770693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 423/830] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:13:57.996728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:57.997539 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:58.004530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:58.005086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:58.005522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:58.006219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:58.006669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:58.007089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:58.085127 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:58.085821 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:58.092482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:58.092967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:58.093403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:58.094165 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:58.094546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:58.095152 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:58.179809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:58.198506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9725820a-c10d-4284-80e2-1abfc20a2bd5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1279 microversion: 2.1 time: 0.205544 Sep 01 18:13:58.201793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 408/831] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:57 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:13:58.243821 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:58.252153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:58.253992 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:58.254910 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2dcf1cd8-fc23-42ec-aeb4-bdac17f01126 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1745 microversion: 2.20 time: 0.175799 Sep 01 18:13:58.264744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 424/832] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:58 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:13:59.219435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:59.219965 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:59.226967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:59.227441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:59.227869 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:59.228582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:59.229023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:59.229438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:59.278019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:13:59.278601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:13:59.285477 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:59.286206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:59.286627 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:59.287303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:13:59.287748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:13:59.288164 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:13:59.359857 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:59.368082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cdcf76d2-4798-41f7-9e38-1dedd8a1ee0f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.152542 Sep 01 18:13:59.368679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 409/833] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:13:59 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:13:59.415050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:59.418550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:13:59.423407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:59.425612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:13:59.430660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-01bd739d-c87a-43f4-9e84-6e475bda9483 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1745 microversion: 2.20 time: 0.152674 Sep 01 18:13:59.430660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 425/834] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:13:59 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:14:00.389280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:00.389993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:00.396889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:00.397360 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:00.397790 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:00.398473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:00.398917 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:00.399347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:00.451899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:00.452527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:00.461995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:00.462718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:00.463317 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:00.464244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:00.464867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:00.465624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:00.568674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:00.576473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2d4ca9da-d126-4e50-a4a8-230bbf12d025 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.191260 Sep 01 18:14:00.584022 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 410/835] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:00 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:00.609898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:00.618791 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:00.620239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:00.621426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-21dcc8ed-629b-4817-bae9-32b572c7b0fa tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.173758 Sep 01 18:14:00.622135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 426/836] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:00 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:14:01.597230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:01.598437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:01.610382 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:01.610872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:01.611584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:01.612650 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:01.612815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:01.613449 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:01.633161 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:01.646356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:01.647536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:01.657116 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:01.657599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:01.664394 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:01.664394 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:01.664394 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:01.664394 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:01.804486 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:01.813793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c7398da5-1bc1-4534-9de2-94c365a5d06e tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.220922 Sep 01 18:14:01.815190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 411/837] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:01 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:01.819742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:01.840485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:01.899276 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:01.909069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:01.910644 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:01.912235 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-29477234-9f3f-49fa-ad4b-bf8f6fe5f40e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.270484 Sep 01 18:14:01.912824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 427/838] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:01 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:02.834680 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:02.835255 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:02.841849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:02.842327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:02.842761 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:02.843452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:02.843906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:02.844563 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:02.996147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:03.005619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c779a9b3-c5f7-4b4a-b4c8-c8d4dda6f02b tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.174745 Sep 01 18:14:03.006361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 412/839] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:02 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:03.097233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:03.098586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:03.106250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:03.106820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:03.107458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:03.108443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:03.109119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:03.109621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:03.255905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:03.265324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:03.268623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:03.269920 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2d975973-58eb-4f5c-a284-c9792b3bb2fb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.338193 Sep 01 18:14:03.270488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 428/840] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:02 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:14:04.026727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:04.027329 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:04.029198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=4 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:04.034951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:04.035436 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:04.036140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:04.036873 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:04.037330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:04.037756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:04.296106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:04.296806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:04.299913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:04.306961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:04.307562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:04.308089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:04.316274 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:04.316274 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:04.316274 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:04.437986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:04.447278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-15a63e77-a8d9-4d47-b038-2ed0bfc0d0e0 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.424244 Sep 01 18:14:04.460587 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 413/841] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:04 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:04.488935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:04.497365 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:04.500672 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:04.500672 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-88ce65d2-c5fa-4a97-830c-ea401446655e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.208376 Sep 01 18:14:04.501188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 429/842] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:04 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:05.469877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:05.471148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:05.473694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=49 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:05.478900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:05.479519 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:05.480029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:05.480935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:05.481593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:05.482292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:05.529454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:05.530007 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:05.544596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:05.545086 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:05.545521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:05.546241 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:05.557014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:05.557478 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:05.667555 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:05.685764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cc638f70-cdd5-45b5-993a-37f9ed0936ca tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.219999 Sep 01 18:14:05.686444 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 414/843] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:05 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:05.737779 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:05.751697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:05.754158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:05.755574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-02bf5cc9-5b7a-42e3-bc03-b4faed6a8d31 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.230075 Sep 01 18:14:05.764621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 430/844] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:05 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:06.709886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:06.710642 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:06.718296 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:06.718795 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:06.719745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:06.719999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:06.721034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:06.721479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:06.784716 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:06.787159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:06.803079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:06.803571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:06.804009 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:06.805899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:06.806362 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:06.806788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:06.944798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:06.953298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f4146a53-79bb-4457-885b-7443fb50fd91 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.249727 Sep 01 18:14:06.955650 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 415/845] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:06 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:14:07.026740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:07.037022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:07.038455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:07.039681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f4a49805-ed13-45b1-a1ea-7e38f5fbcaf4 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.264546 Sep 01 18:14:07.040361 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 431/846] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:06 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:14:07.975862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:07.976509 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:07.983290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:07.983810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:07.984236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:07.985075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:07.985525 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:07.986526 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:08.083089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:08.083829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:08.091115 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:08.091934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:08.092464 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:08.093243 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:08.093772 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:08.094259 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:08.157592 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:08.166623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6756defc-68ab-4c11-a23b-271521dc8d49 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.194568 Sep 01 18:14:08.167204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 416/847] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:07 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:14:08.227125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:08.235401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:08.239727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:08.239727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fdaea7c9-c55f-460f-8c76-aeb64d877361 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.164432 Sep 01 18:14:08.239727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 432/848] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:08 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:09.193272 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:09.196986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:09.206046 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:09.210477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:09.211466 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:09.212487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:09.213151 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:09.214052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:09.261942 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:09.263089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:09.270377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:09.270864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:09.271296 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:09.271994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:09.272692 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:09.273309 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:09.399391 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:09.408927 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-32d18343-2cfe-43f9-b6b6-fd86f980b6f1 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.223952 Sep 01 18:14:09.410720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 417/849] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:09 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:09.431955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:09.444060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:09.445460 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:09.446709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-457d473e-50e3-4c36-9969-c4ee2aa736f9 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.188580 Sep 01 18:14:09.447310 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 433/850] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:09 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:09.935572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-99240df6-c3b2-42a8-bdf0-b5553a3e040c req-4fdf0840-aef7-47f4-a257-3d0b5722ad9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f037dc-fe5b-4c8a-9e5d-faa28369c547", "name": "network-vif-plugged", "status": "completed", "tag": "f142999c-d83d-48ea-ba43-7dbe15c72c06"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:14:09.946339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-99240df6-c3b2-42a8-bdf0-b5553a3e040c req-4fdf0840-aef7-47f4-a257-3d0b5722ad9c service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:09.946812 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-99240df6-c3b2-42a8-bdf0-b5553a3e040c req-4fdf0840-aef7-47f4-a257-3d0b5722ad9c service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:09.947241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-99240df6-c3b2-42a8-bdf0-b5553a3e040c req-4fdf0840-aef7-47f4-a257-3d0b5722ad9c service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:09.959053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-99240df6-c3b2-42a8-bdf0-b5553a3e040c req-4fdf0840-aef7-47f4-a257-3d0b5722ad9c service nova] Creating event network-vif-plugged:f142999c-d83d-48ea-ba43-7dbe15c72c06 for instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 on hv-cinder-74915 Sep 01 18:14:09.964711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-99240df6-c3b2-42a8-bdf0-b5553a3e040c req-4fdf0840-aef7-47f4-a257-3d0b5722ad9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033624 Sep 01 18:14:09.966966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 418/851] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:14:10.431061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:10.432348 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:10.440690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:10.441268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:10.441818 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:10.444851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:10.444851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:10.444851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:10.473715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:10.475128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:10.492560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:10.496914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:10.502473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:10.502473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:10.502473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:10.502473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:10.605359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:10.615391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4a77a850-6b30-4d30-b4ef-9d794ba3c16a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.189305 Sep 01 18:14:10.620677 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 434/852] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:10 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:10.720890 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:10.733920 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:10.736780 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:10.737116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4971bdcc-8027-41d9-b004-965ed8e376fd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.269547 Sep 01 18:14:10.737673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 419/853] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:10 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:14:11.637048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:11.637723 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:11.644675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:11.645160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:11.645660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:11.646382 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:11.646893 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:11.647343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:11.762730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:11.763355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:11.769823 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:11.770332 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:11.770759 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:11.771449 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:11.771890 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:11.772350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:11.785248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:11.793218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0bcccdf6-da57-428b-8235-ee2dfa5f11cd tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.160532 Sep 01 18:14:11.793782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 435/854] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:11 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:11.908340 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:11.916659 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:11.918131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:11.919278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-201d9aee-1eb0-4a9a-84e9-bc04c920a7ef tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.160526 Sep 01 18:14:11.919832 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 420/855] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:11 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:14:12.816319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:12.816944 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:12.824176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:12.824953 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:12.825734 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:12.826437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:12.826890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:12.827330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:12.943715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:12.944529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:12.951136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:12.951701 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:12.952207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:12.953028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:12.953547 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:12.954040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:12.971028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:12.979240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eb3cf6da-aad7-4067-ad52-186b6239e712 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1267 microversion: 2.1 time: 0.167271 Sep 01 18:14:12.979867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 436/856] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:12 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:13.091745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:13.100872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:13.102349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:13.103553 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d69dc75d-6aff-4c71-a29b-2c303f51380d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.163983 Sep 01 18:14:13.104126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 421/857] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:12 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 18:14:14.000154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:14.000766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:14.007695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:14.008179 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:14.008647 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:14.009334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:14.009782 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:14.010204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:14.128409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:14.129854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:14.136192 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:14.136776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:14.137215 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:14.138109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:14.138596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:14.139025 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:14.144129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:14.153815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fdf87855-6e38-436f-b753-a289eec3289f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1454 microversion: 2.1 time: 0.157501 Sep 01 18:14:14.154364 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 437/858] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:13 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:14:14.175243 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:14.176137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:14.182383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:14.182869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:14.183302 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:14.184003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:14.184487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:14.184917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:14.283427 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:14.292907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:14.295590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:14.295590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e3de9838-71e1-4888-9f79-e9fff6579560 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1740 microversion: 2.20 time: 0.172313 Sep 01 18:14:14.296146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 422/859] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:14 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:14.335116 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:14.342960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3ee04333-ca05-46c0-a4a6-e5b8116724d6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1454 microversion: 2.1 time: 0.172018 Sep 01 18:14:14.344131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 438/860] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:14:14 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:14:15.319653 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:15.320260 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:15.326755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:15.327244 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:15.327680 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:15.328530 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:15.329000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:15.329489 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:15.466908 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:15.475209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:15.476706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:15.477880 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e1cbc75e-4eaa-4db3-bea5-be4542cf6e22 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1722 microversion: 2.20 time: 0.162199 Sep 01 18:14:15.478423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 423/861] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:15 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:16.509904 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:16.510676 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:16.518551 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:16.519264 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:16.519812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:16.520683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:16.521246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:16.521777 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:16.552928 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-4686f988-2401-4cbf-9f7b-d6f50979b3f6 req-2e1b8cfa-9fbf-4c57-a0b2-9fae2ccc51bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f037dc-fe5b-4c8a-9e5d-faa28369c547", "tag": "f142999c-d83d-48ea-ba43-7dbe15c72c06"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:14:16.566328 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-4686f988-2401-4cbf-9f7b-d6f50979b3f6 req-2e1b8cfa-9fbf-4c57-a0b2-9fae2ccc51bc service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:16.566959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-4686f988-2401-4cbf-9f7b-d6f50979b3f6 req-2e1b8cfa-9fbf-4c57-a0b2-9fae2ccc51bc service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:16.573014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-4686f988-2401-4cbf-9f7b-d6f50979b3f6 req-2e1b8cfa-9fbf-4c57-a0b2-9fae2ccc51bc service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:16.580227 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-4686f988-2401-4cbf-9f7b-d6f50979b3f6 req-2e1b8cfa-9fbf-4c57-a0b2-9fae2ccc51bc service nova] Creating event network-changed:f142999c-d83d-48ea-ba43-7dbe15c72c06 for instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 on hv-cinder-74915 Sep 01 18:14:16.586266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-4686f988-2401-4cbf-9f7b-d6f50979b3f6 req-2e1b8cfa-9fbf-4c57-a0b2-9fae2ccc51bc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036925 Sep 01 18:14:16.586883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 424/862] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:14:16.670019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:16.679448 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:16.681230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:16.682493 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aa7dd1c6-518c-4145-8fdd-0e3c7d43d959 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1722 microversion: 2.20 time: 0.176705 Sep 01 18:14:16.683289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 439/863] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:16 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:17.712021 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:17.712737 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:17.719003 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:17.719494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:17.719993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:17.721428 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:17.721890 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:17.722319 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:17.823329 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-b746727e-e7c3-416d-be1d-f73d7aad3bee req-0cc5625a-3fc9-461a-8e4c-29dc44a23533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b934582-1b3c-402f-88a5-4d3ebd9b402b", "name": "network-vif-unplugged", "status": "completed", "tag": "ee5cfce4-3d6f-4b56-8883-1152c0054962"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:14:17.835781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b746727e-e7c3-416d-be1d-f73d7aad3bee req-0cc5625a-3fc9-461a-8e4c-29dc44a23533 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:17.836257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b746727e-e7c3-416d-be1d-f73d7aad3bee req-0cc5625a-3fc9-461a-8e4c-29dc44a23533 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:17.836709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b746727e-e7c3-416d-be1d-f73d7aad3bee req-0cc5625a-3fc9-461a-8e4c-29dc44a23533 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:17.848507 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-b746727e-e7c3-416d-be1d-f73d7aad3bee req-0cc5625a-3fc9-461a-8e4c-29dc44a23533 service nova] Creating event network-vif-unplugged:ee5cfce4-3d6f-4b56-8883-1152c0054962 for instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b on hv-cinder-74915 Sep 01 18:14:17.853704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-b746727e-e7c3-416d-be1d-f73d7aad3bee req-0cc5625a-3fc9-461a-8e4c-29dc44a23533 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034507 Sep 01 18:14:17.854291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 440/864] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:14:17.862990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:17.871111 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:17.872639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:17.873796 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-91827660-0cbc-415b-aa34-472b50528741 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1725 microversion: 2.20 time: 0.166738 Sep 01 18:14:17.874345 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 425/865] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:17 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:17.897146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "308d32b4-f492-4ab7-a22f-dc204f2366fd"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:14:17.899642 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:17.905930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:17.906409 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:17.906842 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:17.907603 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:17.908052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:17.908501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:18.599831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:19.153136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-97cd5a73-eb12-402b-9b86-c28d9c407c0c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.260308 Sep 01 18:14:19.153849 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 441/866] 10.222.0.15 () {62 vars in 1364 bytes} [Thu Sep 1 18:14:17 2022] POST /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-volume_attachments => generated 188 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 18:14:19.277750 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:19.278241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:19.284956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:19.285435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:19.286116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:19.286801 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:19.287256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:19.287676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:20.004500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-873529a0-e8ae-4891-883b-459708c97286 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-volume_attachments/308d32b4-f492-4ab7-a22f-dc204f2366fd" status: 202 len: 0 microversion: 2.20 time: 0.730594 Sep 01 18:14:20.005110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 426/867] 10.222.0.15 () {60 vars in 1457 bytes} [Thu Sep 1 18:14:19 2022] DELETE /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-volume_attachments/308d32b4-f492-4ab7-a22f-dc204f2366fd => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:14:20.063784 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:14:20.064278 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:20.071366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:20.071865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:20.072292 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:20.072993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:20.073438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:20.073855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:20.115934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121221) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 18:14:20.441627 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f38dad7c-81fe-4620-8fd6-d0d21ac384d6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "POST /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/action" status: 202 len: 0 microversion: 2.20 time: 0.381784 Sep 01 18:14:20.442556 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 442/868] 10.222.0.15 () {62 vars in 1319 bytes} [Thu Sep 1 18:14:20 2022] POST /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:14:20.450604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:20.451210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:20.607367 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:20.607862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:20.608300 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:20.609104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:20.609560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:20.609983 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:20.613433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:20.746151 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:20.755082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:20.756630 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:20.757796 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7f18a348-1fbf-49cc-b31a-11ef3f08c6e5 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1673 microversion: 2.20 time: 0.311161 Sep 01 18:14:20.758347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 427/869] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:20 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1673 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:21.780912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:21.781611 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:21.787972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:21.788481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:21.789027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:21.789718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:21.790161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:21.790578 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:21.923192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:21.931201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:21.932669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:21.933887 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8650566b-cbb7-408f-879d-617f17e1b943 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1673 microversion: 2.20 time: 0.157470 Sep 01 18:14:21.934449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 443/870] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:21 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:22.958087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:22.958860 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:22.965863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:22.966348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:22.966780 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:22.967848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:22.967950 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:22.968342 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:23.175149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:23.183589 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:23.185210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:23.186355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a665c4e4-c041-45c9-b088-e3b43efc2cad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.233095 Sep 01 18:14:23.186897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 428/871] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:22 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:24.211110 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:24.212201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:24.224667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:24.226213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:24.227240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:24.228166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:24.228832 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:24.229501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:24.420778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:24.430212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:24.431906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:24.433271 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8ceb4cce-fcc1-44f1-a007-3c139585334d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.226644 Sep 01 18:14:24.449053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 444/872] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:24 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:25.458144 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:25.458922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:25.465773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:25.466267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:25.466698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:25.467400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:25.467852 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:25.468274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:25.606066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:25.614986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:25.616446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:25.617609 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5836c9bd-a377-46c7-aa85-ebd1bd392d36 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.164423 Sep 01 18:14:25.618387 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 429/873] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:25 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:26.640135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:26.640759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:26.647612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:26.648088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:26.648541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:26.649232 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:26.649673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:26.650086 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:26.796374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:26.805010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:26.806761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:26.808665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8673c0b3-557a-401b-8be9-bf58d5a19fdd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.172292 Sep 01 18:14:26.809261 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 445/874] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:26 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:27.831841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:27.832481 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:27.838925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:27.839418 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:27.839850 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:27.840585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:27.841037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:27.841463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:27.976550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:27.985060 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:27.987203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:27.988401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0ba59e92-ec51-4b64-bd6d-7c0e61b98335 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.160698 Sep 01 18:14:27.988956 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 430/875] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:27 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:29.011145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:29.011748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:29.018974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:29.019532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:29.020032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:29.020820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:29.021347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:29.021833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:29.151178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:29.159413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:29.160886 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:29.167778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-445cdf85-3c16-4407-8167-59959887fe7f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.155160 Sep 01 18:14:29.167778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 446/876] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:29 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:30.185323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:30.185910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:30.189275 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:14:30.189419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Thu Sep 1 18:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b (ip 10.222.0.15) !!! Sep 01 18:14:30.201016 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:30.206386 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:30.206386 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:30.206386 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:30.206386 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:30.206738 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:30.345563 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:30.353970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:30.355410 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:30.356602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5071af53-b441-444c-b10a-09be7f605fd6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.175389 Sep 01 18:14:30.357157 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 431/877] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:30 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:31.380177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:31.380834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:31.387393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:31.388718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:31.388718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:31.389141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:31.389588 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:31.390028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:31.526539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:31.535505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:31.537212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:31.538385 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-404dfd6b-1700-4382-a86a-7b2fac17045e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.162560 Sep 01 18:14:31.539142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 447/878] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:31 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:32.561805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:32.562435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:32.569737 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:32.570306 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:32.570932 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:32.571727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:32.572254 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:32.572780 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:32.710966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:32.721398 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:32.723405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:32.724884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b9f88848-af02-416c-a8da-d0ce2e6c2f2d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.167292 Sep 01 18:14:32.725843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 432/879] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:32 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:33.762716 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:33.763342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:33.770537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:33.771016 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:33.771443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:33.772160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:33.772657 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:33.773072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:33.907317 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:33.916577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:33.918027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:33.919200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bf05fc67-bbcb-4f93-a611-42ec0e42ac13 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.160458 Sep 01 18:14:33.919777 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 448/880] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:33 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:34.942619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:34.943231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:34.950053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:34.950556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:34.950990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:34.951698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:34.952153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:34.952601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:35.084897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:35.093051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:35.094522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:35.095740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dc1c709b-8273-4f36-9e86-67b7d4bb6fcd tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.157450 Sep 01 18:14:35.096532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 433/881] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:34 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:36.119024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:36.119724 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:36.122470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:36.128405 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:36.128890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:36.129317 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:36.130010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:36.130452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:36.130913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:36.335859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:36.335859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:36.336711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:36.336711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-56dbf526-b394-4afc-9598-94a151023b54 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.167620 Sep 01 18:14:36.336711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 449/882] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:36 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:37.360409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:37.360409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:37.362117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=40 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:37.366751 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:37.367228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:37.367658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:37.368363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:37.368811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:37.369231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:37.502249 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:37.510501 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:37.511862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:37.513050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fc0174ae-3a33-4d8c-a618-5cf2f91b04ad tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.158045 Sep 01 18:14:37.513905 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 434/883] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:37 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:38.536535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:38.537065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:38.543532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:38.544000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:38.544480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:38.545155 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:38.545598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:38.546013 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:38.681157 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:38.689244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:38.690681 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:38.691834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9b498631-4246-4714-b842-4641ada54cbb tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.160339 Sep 01 18:14:38.692404 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 450/884] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:38 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:39.715131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:39.715733 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:39.722827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:39.725432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:39.725432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:39.725432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:39.725432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:39.725809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:39.865125 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:39.873421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:39.874884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:39.876261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a0a213a2-a7ee-47a3-820d-b145293b90ac tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.165339 Sep 01 18:14:39.876834 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 435/885] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:39 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:40.899310 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:40.900395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:40.906737 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:40.907543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:40.907990 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:40.908714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:40.909176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:40.909605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:41.034282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:41.042517 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:41.043965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:41.045151 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2528aa38-d6ff-4d8d-b472-fd05598b078e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.149700 Sep 01 18:14:41.045709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 451/886] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:40 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:42.069294 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:42.069845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:42.076975 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:42.077458 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:42.077888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:42.079213 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:42.079871 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:42.080349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:42.215683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:42.224007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:42.225474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:42.226639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3579e419-3617-4c15-8259-1946197b5b65 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.161642 Sep 01 18:14:42.227201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 436/887] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:42 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:43.249269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:43.249892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:43.256496 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:43.256976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:43.257403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:43.258083 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:43.258527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:43.258939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:43.392047 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:43.399996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:43.401461 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:43.402599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-53014d46-654a-40e5-b73e-2f145b52a838 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.157217 Sep 01 18:14:43.403142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 452/888] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:43 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:44.021677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-2d7008b6-1070-4dbc-8257-0e6ff6903183 req-cc24da66-8936-4ee9-ade7-989bc8fdbcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b934582-1b3c-402f-88a5-4d3ebd9b402b", "name": "network-vif-plugged", "status": "completed", "tag": "ee5cfce4-3d6f-4b56-8883-1152c0054962"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:14:44.031628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d7008b6-1070-4dbc-8257-0e6ff6903183 req-cc24da66-8936-4ee9-ade7-989bc8fdbcb3 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:44.032104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d7008b6-1070-4dbc-8257-0e6ff6903183 req-cc24da66-8936-4ee9-ade7-989bc8fdbcb3 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:44.032566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d7008b6-1070-4dbc-8257-0e6ff6903183 req-cc24da66-8936-4ee9-ade7-989bc8fdbcb3 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:44.043564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-2d7008b6-1070-4dbc-8257-0e6ff6903183 req-cc24da66-8936-4ee9-ade7-989bc8fdbcb3 service nova] Creating event network-vif-plugged:ee5cfce4-3d6f-4b56-8883-1152c0054962 for instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b on hv-cinder-74915 Sep 01 18:14:44.049064 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-2d7008b6-1070-4dbc-8257-0e6ff6903183 req-cc24da66-8936-4ee9-ade7-989bc8fdbcb3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Sep 01 18:14:44.049742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 437/889] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:14:44.427263 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:44.427800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:44.434489 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:44.438998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:44.438998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:44.438998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:44.438998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:44.439435 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:44.569369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:44.577365 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:44.579809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:44.582253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c2dad968-a783-46a3-9507-dd8c089af70e tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.158854 Sep 01 18:14:44.582832 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 453/890] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:44 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:45.608906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:45.610123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:45.616609 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:45.617089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:45.617520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:45.618208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:45.618658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:45.619142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:45.748782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:45.756748 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:45.758174 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:45.759317 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7c4a94c2-08cc-4769-b611-0fcf3bfa7f01 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.155424 Sep 01 18:14:45.759863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 438/891] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:45 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:46.782877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:46.783489 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:46.791538 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:46.792007 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:46.792497 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:46.793190 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:46.793634 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:46.794054 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:46.925898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:46.933890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:46.935323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:46.936511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-38aec7de-4ccc-4611-8718-3f9367f96fd3 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.158121 Sep 01 18:14:46.937064 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 454/892] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:46 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:47.959279 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:47.959864 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:47.966520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:47.967001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:47.967436 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:47.968127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:47.968618 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:47.969719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:48.098318 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:48.106520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:48.107971 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:48.109164 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2d5d95af-c156-4e55-a017-4c1d9e25d92f tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1731 microversion: 2.20 time: 0.153923 Sep 01 18:14:48.110408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 439/893] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:47 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:49.132323 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:49.132933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:49.139308 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:49.139781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:49.140212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:49.141034 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:49.141480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:49.141897 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:49.145732 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:14:49.270008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:49.278004 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:49.279444 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:14:49.280623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3e578855-43e7-4951-9315-a84f06fba892 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1718 microversion: 2.20 time: 0.152219 Sep 01 18:14:49.281220 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 455/894] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:14:49 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:14:51.770988 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:14:51.771576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:51.777966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:51.778451 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:51.778884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:51.779602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:51.780051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:51.780519 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:51.804684 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9aaf50f8-e785-4e11-8a78-2c7401aa5ea2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/ips" status: 200 len: 146 microversion: 2.1 time: 0.037610 Sep 01 18:14:51.816440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 440/895] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:14:51 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:14:55.403186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6a8fa45-cd88-491b-99c9-9793c41caf1e"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:14:55.405615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:14:55.413433 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:55.413909 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:55.414334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:55.415014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:14:55.415455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:14:55.415870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:14:56.151286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-abc096fb-311e-46cb-b207-1f937a220474 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752195 Sep 01 18:14:56.151889 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 456/896] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:14:55 2022] POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:15:00.016056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:00.016723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:00.019965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-3110cf5e-0dc6-4f0c-b154-55824426c4d0 req-c58608be-4bf8-4a98-a2b3-df37bf808d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f510cd-8ecf-4e9d-a60f-97277d17b97c", "tag": "2e2fab45-f892-4f70-bdce-c498f573098d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:15:00.024209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:00.024758 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:00.025142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:00.025860 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:00.026308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:00.026756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:00.030185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3110cf5e-0dc6-4f0c-b154-55824426c4d0 req-c58608be-4bf8-4a98-a2b3-df37bf808d0f service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:00.031316 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3110cf5e-0dc6-4f0c-b154-55824426c4d0 req-c58608be-4bf8-4a98-a2b3-df37bf808d0f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:00.031455 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=78 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:00.031820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3110cf5e-0dc6-4f0c-b154-55824426c4d0 req-c58608be-4bf8-4a98-a2b3-df37bf808d0f service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:00.045303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-3110cf5e-0dc6-4f0c-b154-55824426c4d0 req-c58608be-4bf8-4a98-a2b3-df37bf808d0f service nova] Creating event network-changed:2e2fab45-f892-4f70-bdce-c498f573098d for instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c on hv-cinder-74915 Sep 01 18:15:00.050553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-3110cf5e-0dc6-4f0c-b154-55824426c4d0 req-c58608be-4bf8-4a98-a2b3-df37bf808d0f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035786 Sep 01 18:15:00.051558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 457/897] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:15:00.052564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:15:00.364773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d7ae8339-1f97-4c30-b4a3-3f84c897c40c tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 204 len: 0 microversion: 2.1 time: 0.352301 Sep 01 18:15:00.369387 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 441/898] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:15:00 2022] DELETE /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:15:00.375485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:00.376219 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:00.385781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:00.386364 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:00.386871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:00.388295 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:00.389183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:00.389360 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:00.533576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:00.541562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a489b5df-691d-4085-8115-f2dd8a4c4b62 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.170931 Sep 01 18:15:00.542130 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 458/899] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:00 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:01.566285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:01.566984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:01.573791 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:01.574284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:01.574711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:01.575411 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:01.575853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:01.576269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:01.889063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:01.897057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cea7336b-f97b-4774-8558-580fddaceba7 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1570 microversion: 2.1 time: 0.335708 Sep 01 18:15:01.897649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 442/900] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:01 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1570 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:02.904363 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-2f079a47-f8a4-4e86-adfb-8082d5646d1d req-95b36452-2db2-4810-91c2-30799849dd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f510cd-8ecf-4e9d-a60f-97277d17b97c", "name": "network-vif-deleted", "tag": "2e2fab45-f892-4f70-bdce-c498f573098d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:15:02.914933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2f079a47-f8a4-4e86-adfb-8082d5646d1d req-95b36452-2db2-4810-91c2-30799849dd61 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:02.914933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2f079a47-f8a4-4e86-adfb-8082d5646d1d req-95b36452-2db2-4810-91c2-30799849dd61 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:02.915141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2f079a47-f8a4-4e86-adfb-8082d5646d1d req-95b36452-2db2-4810-91c2-30799849dd61 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:02.919271 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:02.919922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:02.926781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:02.927518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:02.927662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-2f079a47-f8a4-4e86-adfb-8082d5646d1d req-95b36452-2db2-4810-91c2-30799849dd61 service nova] Creating event network-vif-deleted:2e2fab45-f892-4f70-bdce-c498f573098d for instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c on hv-cinder-74915 Sep 01 18:15:02.927952 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:02.928715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:02.929170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:02.929649 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:02.932746 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-2f079a47-f8a4-4e86-adfb-8082d5646d1d req-95b36452-2db2-4810-91c2-30799849dd61 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092247 Sep 01 18:15:02.937132 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 459/901] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:15:02.993941 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:03.002335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-87b2c071-d430-406f-80be-e972bba13562 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1383 microversion: 2.1 time: 0.087259 Sep 01 18:15:03.005848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 443/902] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:02 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1383 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:04.024796 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:04.025494 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:04.031694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:04.032181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:04.032641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:04.034038 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:04.034638 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:04.035075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:04.107945 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:04.115806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1bf873f9-52e3-4a1b-8582-a73a58798fbd tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1220 microversion: 2.1 time: 0.095767 Sep 01 18:15:04.116482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 460/903] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:04 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:04.774765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cb4a5c7b-11f3-4e43-9fbf-49a1bc4c811e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:15:04.781219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cb4a5c7b-11f3-4e43-9fbf-49a1bc4c811e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:04.781703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cb4a5c7b-11f3-4e43-9fbf-49a1bc4c811e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:04.782138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cb4a5c7b-11f3-4e43-9fbf-49a1bc4c811e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:04.846548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cb4a5c7b-11f3-4e43-9fbf-49a1bc4c811e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Going to try to stop instance {{(pid=121220) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 18:15:05.110213 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cb4a5c7b-11f3-4e43-9fbf-49a1bc4c811e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action" status: 202 len: 0 microversion: 2.1 time: 0.339102 Sep 01 18:15:05.110818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 444/904] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:15:04 2022] POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:15:05.118995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:05.120182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:05.126607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:05.127939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:05.128511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:05.129244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:05.129737 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:05.130216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:05.137605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:05.138440 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:05.145846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:05.146390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:05.150552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:05.150552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:05.150552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:05.150552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:05.180839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:05.181465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:05.181900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:05.182399 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lazy-loading 'fault' on Instance uuid e6f510cd-8ecf-4e9d-a60f-97277d17b97c {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:15:05.227310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9132e6a676054c93ba33d95d28ded4da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6caf631e5849f6867042a1f6dcf6aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:05.234929 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8835e537-2f35-4372-bab0-77a7822fbdad tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 200 len: 1179 microversion: 2.1 time: 0.102098 Sep 01 18:15:05.235715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 445/905] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:05 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 1179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:15:05.275038 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:05.283397 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4098420c-f11b-41b5-a13b-7b35c43605a5 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.168074 Sep 01 18:15:05.283954 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 461/906] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:05 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:06.255078 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:06.255690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] [instance: e6f510cd-8ecf-4e9d-a60f-97277d17b97c] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:06.262118 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:06.262646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:06.263028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:06.263718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:06.264166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:06.264609 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:06.278094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] HTTP exception thrown: Instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c could not be found. Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Request method failure captured: Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c HTTP/1.1 Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPTF_KjzKaAxqPIglZPpxfL6AdRm9wkDl-RgRvswmjB8U5jwu9O60Dhc2pO_tBwsJbJtBt5NIpZltBjCiETH1R_b2S3D4KYQJ1B-OcStgmHIj6UJp1EzAUHVSk_w-PuCYWAXXYODTjwvofjclj3pgYuLYA74uFyR0l3NQs6m3vzYgXc Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 0a6caf631e5849f6867042a1f6dcf6aa Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-TestShelveInstance-625927893 Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:15:06.279723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0a6caf631e5849f6867042a1f6dcf6aa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0a6caf631e5849f6867042a1f6dcf6aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0a6caf631e5849f6867042a1f6dcf6aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0a6caf631e5849f6867042a1f6dcf6aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-TestShelveInstance-625927893 Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 0a6caf631e5849f6867042a1f6dcf6aa Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-TestShelveInstance-625927893 Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-TestShelveInstance-625927893-project Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 9132e6a676054c93ba33d95d28ded4da Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-TestShelveInstance-625927893-project Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c could not be found. Sep 01 18:15:06.281282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'e6f510cd-8ecf-4e9d-a60f-97277d17b97c'} Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c could not be found. Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:15:06.282155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c could not be found. Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c could not be found. Sep 01 18:15:06.284577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:06.286164 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Returning 404 to user: Instance e6f510cd-8ecf-4e9d-a60f-97277d17b97c could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:15:06.286164 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-50a698ea-c7f4-4bf8-97f5-1524a59fb987 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c" status: 404 len: 111 microversion: 2.1 time: 0.030010 Sep 01 18:15:06.286164 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 446/907] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:06 2022] GET /compute/v2.1/servers/e6f510cd-8ecf-4e9d-a60f-97277d17b97c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:15:06.304215 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:06.304778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:06.307216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=26 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:06.312096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:06.312626 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:06.313060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:06.313752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:06.314284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:06.314916 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:06.488128 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:06.496721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-97006efb-c4c4-4453-8c5d-1187fb80f273 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.196401 Sep 01 18:15:06.497461 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 462/908] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:06 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:06.562978 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3028cf85-9939-42ab-8e25-986fdc241344 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] Calling method '.version_select at 0x7f446a87aaf0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:06.633895 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3028cf85-9939-42ab-8e25-986fdc241344 tempest-TestShelveInstance-625927893 tempest-TestShelveInstance-625927893-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1466158584" status: 202 len: 0 microversion: 2.1 time: 0.074848 Sep 01 18:15:06.634536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 447/909] 10.222.0.15 () {58 vars in 1254 bytes} [Thu Sep 1 18:15:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1466158584 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:15:07.518101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:07.518640 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:07.524971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:07.525446 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:07.525874 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:07.526547 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:07.526990 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:07.527403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:07.785884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:07.794833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-60783adf-0ee3-4889-bbee-2cf017b5498f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.280674 Sep 01 18:15:07.795580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 463/910] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:07 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:08.817420 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:08.818336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:08.826000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:08.826596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:08.827259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:08.828027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:08.828725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:08.829280 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:08.969225 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:08.977366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-914d1e1f-a3fb-4577-bf24-12c17218f66c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.164404 Sep 01 18:15:08.977927 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 448/911] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:08 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:09.998616 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:09.999241 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:10.006494 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:10.006978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:10.007631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:10.008356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:10.008984 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:10.009405 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:10.163676 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:10.172024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f13d178d-dbf7-4248-a888-dbee6f247bf4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.177296 Sep 01 18:15:10.172615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 464/912] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:09 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:11.197988 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:11.198525 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:11.201099 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:11.206446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:11.206949 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:11.207366 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:11.208056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:11.208713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:11.209146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:11.420136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:11.428515 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f2a6cf15-67e0-4c92-b05a-48d22e2716ac tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.234488 Sep 01 18:15:11.429113 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 449/913] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:11 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:12.450458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:12.451911 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:12.459204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:12.460151 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:12.460829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:12.461753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:12.462428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:12.463056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:12.605812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:12.618094 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-152bd43e-bfae-4d94-a4a7-8ca8cb557129 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.171418 Sep 01 18:15:12.619018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 465/914] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:12 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:13.640172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:13.640867 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:13.647898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:13.648484 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:13.648922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:13.649625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:13.650077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:13.650502 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:13.816572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:13.829418 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bc5f73df-0864-47d3-95d8-f5688656a120 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.192984 Sep 01 18:15:13.844748 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 450/915] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:13 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:14.852259 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:14.852938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:14.859346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:14.859825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:14.860260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:14.861082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:14.861542 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:14.861964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:15.015900 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:15.029825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0e374cbc-181c-489c-8793-25da12d0c835 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.181044 Sep 01 18:15:15.031224 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 466/916] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:14 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:16.051439 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:16.052109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:16.058661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:16.059129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:16.059585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:16.060258 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:16.060735 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:16.061157 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:16.208819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:16.217306 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-378f2860-301e-4a1f-8f4f-fcc84fe2b511 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.169817 Sep 01 18:15:16.218070 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 451/917] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:16 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:17.239814 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:17.240399 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:17.246848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:17.247324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:17.247752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:17.248469 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:17.248915 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:17.249339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:17.383010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:17.401147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-79828fcf-f6a0-444e-9fb0-989c23e1eda4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.165499 Sep 01 18:15:17.405860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 467/918] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:17 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:18.422746 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:18.423353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:18.429853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:18.430336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:18.430773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:18.431466 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:18.431925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:18.432378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:18.560285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:18.568898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6a42b482-4b39-4bbc-8f97-a03cafeca3fa tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.150107 Sep 01 18:15:18.569427 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 452/919] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:18 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:19.589670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:19.590231 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:19.596662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:19.597135 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:19.597562 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:19.598824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:19.599269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:19.599685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:19.728043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:19.736095 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d05dc801-9549-4885-a699-192e9d8a66f7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.150339 Sep 01 18:15:19.736688 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 468/920] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:19 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:20.757736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:20.758360 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:20.765031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:20.765523 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:20.765965 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:20.766694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:20.767152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:20.767610 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:20.906689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:20.915603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d6ee5d2d-a732-4fb8-a2d9-f2da14c9f1ef tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1724 microversion: 2.1 time: 0.162459 Sep 01 18:15:20.918140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 453/921] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:20 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:21.937468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:21.938069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:21.945070 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:21.945545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:21.945973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:21.946646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:21.947093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:21.947515 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:22.073914 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:22.082482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aa33e3f4-0bec-4af1-bce4-9f28d2b4e6f0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1701 microversion: 2.1 time: 0.148685 Sep 01 18:15:22.083053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 469/922] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:21 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:22.102531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-87bf9ccc-b58a-40a9-9a79-21bf1998ebae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:15:22.108909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87bf9ccc-b58a-40a9-9a79-21bf1998ebae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:22.109383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87bf9ccc-b58a-40a9-9a79-21bf1998ebae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:22.109815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-87bf9ccc-b58a-40a9-9a79-21bf1998ebae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:22.145707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-87bf9ccc-b58a-40a9-9a79-21bf1998ebae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Going to try to start instance {{(pid=121220) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 18:15:22.338246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-87bf9ccc-b58a-40a9-9a79-21bf1998ebae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action" status: 202 len: 0 microversion: 2.1 time: 0.239296 Sep 01 18:15:22.338807 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 454/923] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:15:22 2022] POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:15:22.346821 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:22.348962 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:22.354268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:22.354750 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:22.355180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:22.355867 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:22.356339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:22.356765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:22.484441 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:22.493201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8da5db2a-5ba9-4198-b23b-9c71fedd9069 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1710 microversion: 2.1 time: 0.150168 Sep 01 18:15:22.493776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 470/924] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:22 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:23.515657 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:23.516294 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:23.522516 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:23.522994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:23.523428 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:23.524114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:23.524592 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:23.525017 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:23.539817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:23.651562 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:23.659607 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b2f61417-42f9-41ca-8bdd-ab0945498cfd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1710 microversion: 2.1 time: 0.148774 Sep 01 18:15:23.660159 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 455/925] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:23 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:24.680714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:24.681312 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:24.688168 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:24.688702 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:24.689440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:24.690138 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:24.690655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:24.691077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:24.842751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:24.844923 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:24.852576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-665aca09-6aa8-4de1-8d65-ca90c4025b41 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1714 microversion: 2.1 time: 0.175902 Sep 01 18:15:24.853150 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 471/926] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:15:24 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:48.399636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:48.401911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:48.404793 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=13 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:48.409877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:48.410623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:48.411053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:48.411994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:48.412508 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:48.412924 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:48.442590 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-382c38be-4c55-4287-99d5-724d0ec1865a tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047390 Sep 01 18:15:48.443317 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 456/927] 10.222.0.15 () {60 vars in 1343 bytes} [Thu Sep 1 18:15:48 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:15:48.506960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:48.507457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:48.509906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=19 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:15:48.514988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:48.515476 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:48.515907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:48.516616 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:48.517066 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:48.517484 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:48.542937 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:15:49.054554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-78624ba0-e794-47eb-a131-4a6d51356dc6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 204 len: 0 microversion: 2.20 time: 0.551832 Sep 01 18:15:49.055148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 472/928] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 1 18:15:48 2022] DELETE /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 18:15:49.063724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:49.064353 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:49.070511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:49.070990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:49.071422 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:49.072129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:49.072619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:49.073037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:49.199603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:49.208264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:49.209722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:49.210874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d963c47e-72d6-4c3c-ac50-3678c4766fa6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.151496 Sep 01 18:15:49.211432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 457/929] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:15:49 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:15:50.234872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:50.235660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:50.243308 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:50.254079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:50.254079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:50.254079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:50.254079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:50.254662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:50.385569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:50.393881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:50.396740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:50.398196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-889044c6-6843-44fb-a916-a388d3087c98 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1724 microversion: 2.20 time: 0.167454 Sep 01 18:15:50.398583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 473/930] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:15:50 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:15:51.421679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:51.422288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:51.429180 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:51.429566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:51.430049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:51.430700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:51.431155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:51.431582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:51.505977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:51.513826 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:51.515276 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:51.516460 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8e657a43-5c42-474d-a9f2-116060e3c1a6 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1657 microversion: 2.20 time: 0.099288 Sep 01 18:15:51.517020 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 458/931] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:15:51 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1657 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:15:51.715275 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-090d09c4-861d-4f39-abb8-cb0d5b78c3c5 req-b4a2c65e-1472-49bb-9675-c0348f0f0dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b934582-1b3c-402f-88a5-4d3ebd9b402b", "name": "network-vif-deleted", "tag": "ee5cfce4-3d6f-4b56-8883-1152c0054962"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:15:51.725210 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-090d09c4-861d-4f39-abb8-cb0d5b78c3c5 req-b4a2c65e-1472-49bb-9675-c0348f0f0dcf service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:51.725680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-090d09c4-861d-4f39-abb8-cb0d5b78c3c5 req-b4a2c65e-1472-49bb-9675-c0348f0f0dcf service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:51.726104 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-090d09c4-861d-4f39-abb8-cb0d5b78c3c5 req-b4a2c65e-1472-49bb-9675-c0348f0f0dcf service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:51.737117 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-090d09c4-861d-4f39-abb8-cb0d5b78c3c5 req-b4a2c65e-1472-49bb-9675-c0348f0f0dcf service nova] Creating event network-vif-deleted:ee5cfce4-3d6f-4b56-8883-1152c0054962 for instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b on hv-cinder-74915 Sep 01 18:15:51.742049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-090d09c4-861d-4f39-abb8-cb0d5b78c3c5 req-b4a2c65e-1472-49bb-9675-c0348f0f0dcf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030478 Sep 01 18:15:51.742714 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 474/932] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:15:52.541843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:52.542459 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:52.549277 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:52.549846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:52.550355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:52.551721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:52.552261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:52.552969 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:52.586972 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:52.587462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:52.587901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:52.588381 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lazy-loading 'fault' on Instance uuid 9b934582-1b3c-402f-88a5-4d3ebd9b402b {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:15:52.637010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:52.640724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:52.642181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb6a740de8b9417b89afb08f230aa4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b40443d415fa40338b837dd445032342', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:15:52.643356 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b821aa51-95b8-49b3-a665-fda1cbdecc41 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 200 len: 1372 microversion: 2.20 time: 0.105630 Sep 01 18:15:52.643923 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 459/933] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:15:52 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 18:15:53.667900 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:53.668618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:53.674798 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:53.675280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:53.675721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:53.676926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:53.677387 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:53.677809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:53.690794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] HTTP exception thrown: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Request method failure captured: Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b HTTP/1.1 Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQPMjlnbScpzWjczEDLUhmziXYzO-BOb8yJi47DS2irRsqgM5xrQ02Q5CBmqOSx6Qrp08SkSCpBLynwPyR4eXEetoqtCTgUm0SNiCSnNb0MyIFGfp1PEs3Vxy8Pjim9dPg85X3cBEsaOInodK59ogycPjNyezn59CA1szqO6OvJtOE Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:15:53.693077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b40443d415fa40338b837dd445032342", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b40443d415fa40338b837dd445032342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: fb6a740de8b9417b89afb08f230aa4b7 Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:53.694871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '9b934582-1b3c-402f-88a5-4d3ebd9b402b'} Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:15:53.695929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:53.697552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:53.699216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Returning 404 to user: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:15:53.699216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f7bc9e4e-e50d-4092-bd98-1c14ad025f64 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 404 len: 111 microversion: 2.20 time: 0.031353 Sep 01 18:15:53.699216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 475/934] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:15:53 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:15:53.703954 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7a7c05ba-9012-455e-abf1-df05a9b9c816 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '.version_select at 0x7f446a8ad9d0>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:53.781013 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7a7c05ba-9012-455e-abf1-df05a9b9c816 tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062790780" status: 204 len: 0 microversion: 2.20 time: 0.080836 Sep 01 18:15:53.781574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 460/935] 10.222.0.15 () {60 vars in 1262 bytes} [Thu Sep 1 18:15:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062790780 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 18:15:55.865258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:55.865758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:55.872156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:55.872654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:55.873081 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:55.873760 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:55.874200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:55.874614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:55.887621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] HTTP exception thrown: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Request method failure captured: Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b HTTP/1.1 Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQPMjlnbScpzWjczEDLUhmziXYzO-BOb8yJi47DS2irRsqgM5xrQ02Q5CBmqOSx6Qrp08SkSCpBLynwPyR4eXEetoqtCTgUm0SNiCSnNb0MyIFGfp1PEs3Vxy8Pjim9dPg85X3cBEsaOInodK59ogycPjNyezn59CA1szqO6OvJtOE Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:15:55.889153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b40443d415fa40338b837dd445032342", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b40443d415fa40338b837dd445032342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: fb6a740de8b9417b89afb08f230aa4b7 Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.890808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '9b934582-1b3c-402f-88a5-4d3ebd9b402b'} Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:15:55.891591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.893240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.894697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Returning 404 to user: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:15:55.894697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-06085ea8-35e1-4e1c-bf33-8d17f5cfe35d tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 404 len: 111 microversion: 2.20 time: 0.029224 Sep 01 18:15:55.894697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 476/936] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 1 18:15:55 2022] DELETE /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:15:55.900129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:55.900779 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: 9b934582-1b3c-402f-88a5-4d3ebd9b402b] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:55.907506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:55.907982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:55.908441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:55.909142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:55.909572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:55.909991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:55.923370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] HTTP exception thrown: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Request method failure captured: Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b HTTP/1.1 Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQPMjlnbScpzWjczEDLUhmziXYzO-BOb8yJi47DS2irRsqgM5xrQ02Q5CBmqOSx6Qrp08SkSCpBLynwPyR4eXEetoqtCTgUm0SNiCSnNb0MyIFGfp1PEs3Vxy8Pjim9dPg85X3cBEsaOInodK59ogycPjNyezn59CA1szqO6OvJtOE Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:15:55.925014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b40443d415fa40338b837dd445032342", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b40443d415fa40338b837dd445032342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: fb6a740de8b9417b89afb08f230aa4b7 Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.926720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '9b934582-1b3c-402f-88a5-4d3ebd9b402b'} Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:15:55.927633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. Sep 01 18:15:55.929145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:55.930415 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Returning 404 to user: Instance 9b934582-1b3c-402f-88a5-4d3ebd9b402b could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:15:55.930415 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-185ce2fd-d03c-40a1-918d-f443a28a374b tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b" status: 404 len: 111 microversion: 2.20 time: 0.031360 Sep 01 18:15:55.930415 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 461/937] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:15:55 2022] GET /compute/v2.1/servers/9b934582-1b3c-402f-88a5-4d3ebd9b402b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:15:57.243240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:57.243745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:57.250204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:57.250685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:57.251116 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:57.251845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:57.252294 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:57.252762 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:57.267740 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] HTTP exception thrown: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Request method failure captured: Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 HTTP/1.1 Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPQPMjlnbScpzWjczEDLUhmziXYzO-BOb8yJi47DS2irRsqgM5xrQ02Q5CBmqOSx6Qrp08SkSCpBLynwPyR4eXEetoqtCTgUm0SNiCSnNb0MyIFGfp1PEs3Vxy8Pjim9dPg85X3cBEsaOInodK59ogycPjNyezn59CA1szqO6OvJtOE Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:15:57.269318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b40443d415fa40338b837dd445032342", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b40443d415fa40338b837dd445032342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: fb6a740de8b9417b89afb08f230aa4b7 Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.270956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47'} Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:15:57.271986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.273604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.275257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Returning 404 to user: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:15:57.275257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dc1dba1d-f8cf-459f-8eea-1ba0ac05580c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 404 len: 111 microversion: 2.20 time: 0.031888 Sep 01 18:15:57.275257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 477/938] 10.222.0.15 () {60 vars in 1280 bytes} [Thu Sep 1 18:15:57 2022] DELETE /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:15:57.279327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:15:57.279959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] [instance: f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:15:57.286504 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:57.287243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:57.287690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:57.288430 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:15:57.288879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:15:57.289298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:15:57.302373 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] HTTP exception thrown: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Request method failure captured: Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 HTTP/1.1 Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPQPMjlnbScpzWjczEDLUhmziXYzO-BOb8yJi47DS2irRsqgM5xrQ02Q5CBmqOSx6Qrp08SkSCpBLynwPyR4eXEetoqtCTgUm0SNiCSnNb0MyIFGfp1PEs3Vxy8Pjim9dPg85X3cBEsaOInodK59ogycPjNyezn59CA1szqO6OvJtOE Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:15:57.304463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b40443d415fa40338b837dd445032342", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b40443d415fa40338b837dd445032342"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b40443d415fa40338b837dd445032342"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: b40443d415fa40338b837dd445032342 Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-303268669 Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: fb6a740de8b9417b89afb08f230aa4b7 Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeShelveTestJSON-303268669-project Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.306186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47'} Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:15:57.307076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. Sep 01 18:15:57.308556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:15:57.309863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] Returning 404 to user: Instance f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:15:57.309863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bb6e84de-dfda-4556-a780-8d21ab1c065c tempest-AttachVolumeShelveTestJSON-303268669 tempest-AttachVolumeShelveTestJSON-303268669-project] 10.222.0.15 "GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47" status: 404 len: 111 microversion: 2.20 time: 0.030475 Sep 01 18:15:57.309863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 462/939] 10.222.0.15 () {60 vars in 1277 bytes} [Thu Sep 1 18:15:57 2022] GET /compute/v2.1/servers/f3e22e5e-ac8d-45b4-9d8e-4b2bd93b2e47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:16:18.602811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:18.602811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:18.608679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-013cef45-91c1-4e74-92bf-a231fbe743f7 req-93611727-d741-4a3b-bc2a-81b53b0a9ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f037dc-fe5b-4c8a-9e5d-faa28369c547", "tag": "f142999c-d83d-48ea-ba43-7dbe15c72c06"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:16:18.613957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:18.614604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=33 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:18.617561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:18.618402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:18.627937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-013cef45-91c1-4e74-92bf-a231fbe743f7 req-93611727-d741-4a3b-bc2a-81b53b0a9ea0 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:18.628420 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-013cef45-91c1-4e74-92bf-a231fbe743f7 req-93611727-d741-4a3b-bc2a-81b53b0a9ea0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:18.628894 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-013cef45-91c1-4e74-92bf-a231fbe743f7 req-93611727-d741-4a3b-bc2a-81b53b0a9ea0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:18.634773 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:18.635269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:18.636475 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:18.637380 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:18.637829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:18.638248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:18.648939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-013cef45-91c1-4e74-92bf-a231fbe743f7 req-93611727-d741-4a3b-bc2a-81b53b0a9ea0 service nova] Creating event network-changed:f142999c-d83d-48ea-ba43-7dbe15c72c06 for instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 on hv-cinder-74915 Sep 01 18:16:18.654747 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-013cef45-91c1-4e74-92bf-a231fbe743f7 req-93611727-d741-4a3b-bc2a-81b53b0a9ea0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049580 Sep 01 18:16:18.655407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 463/940] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:16:18.669150 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:16:18.980918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c888d62b-c585-4af5-ad66-a6a8b832a7b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 204 len: 0 microversion: 2.1 time: 0.382585 Sep 01 18:16:18.991947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 478/941] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:16:18 2022] DELETE /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:16:18.992150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:18.992616 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:19.000668 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:19.001164 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:19.001829 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:19.002552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:19.003013 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:19.003443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:19.178830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:19.187167 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a913e7e9-87d6-43ad-a9cf-37dc9122ad41 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1579 microversion: 2.1 time: 0.201000 Sep 01 18:16:19.187736 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 464/942] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:18 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:16:20.210776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:20.211462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:20.219261 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:20.219732 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:20.220157 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:20.220875 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:20.221316 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:20.221730 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:20.353615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:20.362017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9beb1bf4-7bd6-4929-adea-e3bcbae7d820 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1579 microversion: 2.1 time: 0.156100 Sep 01 18:16:20.362584 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 479/943] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:20 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:21.382945 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:21.383559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:21.390205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:21.390688 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:21.391124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:21.391815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:21.392303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:21.392754 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:21.528916 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:21.536952 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-77ed9ced-094d-4a2f-812e-4c0f98ee55c6 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1579 microversion: 2.1 time: 0.157920 Sep 01 18:16:21.538050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 465/944] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:21 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:22.559325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:22.559848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:22.566428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:22.566896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:22.567319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:22.567990 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:22.568468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:22.568880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:22.696266 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:22.704422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-962b5d7e-daa2-453e-8bbe-c23265063b35 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1579 microversion: 2.1 time: 0.149498 Sep 01 18:16:22.704977 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 480/945] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:22 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1579 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:16:23.725381 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:23.725997 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:23.732593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:23.733073 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:23.733507 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:23.734201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:23.734655 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:23.735079 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:23.863396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:23.871058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-963c8808-51c2-4a2e-960f-624479306cb2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1460 microversion: 2.1 time: 0.149614 Sep 01 18:16:23.871622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 466/946] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:23 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:24.891122 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:24.891733 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:24.898245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:24.898742 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:24.899180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:24.899878 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:24.900351 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:24.900825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:24.972277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:24.985299 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b274bf8c-0d8b-4199-a55a-b58e4675b5bc tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1392 microversion: 2.1 time: 0.094241 Sep 01 18:16:24.985299 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 481/947] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:24 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1392 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:24.997213 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-37c34495-a8eb-4fb1-a9fc-08a8eee7ec0d req-c5c2f00c-29b5-4dbd-ab81-80c37be78a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f037dc-fe5b-4c8a-9e5d-faa28369c547", "name": "network-vif-deleted", "tag": "f142999c-d83d-48ea-ba43-7dbe15c72c06"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:16:25.009091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-37c34495-a8eb-4fb1-a9fc-08a8eee7ec0d req-c5c2f00c-29b5-4dbd-ab81-80c37be78a85 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:25.009091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-37c34495-a8eb-4fb1-a9fc-08a8eee7ec0d req-c5c2f00c-29b5-4dbd-ab81-80c37be78a85 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:25.009091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-37c34495-a8eb-4fb1-a9fc-08a8eee7ec0d req-c5c2f00c-29b5-4dbd-ab81-80c37be78a85 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:25.020981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-37c34495-a8eb-4fb1-a9fc-08a8eee7ec0d req-c5c2f00c-29b5-4dbd-ab81-80c37be78a85 service nova] Creating event network-vif-deleted:f142999c-d83d-48ea-ba43-7dbe15c72c06 for instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 on hv-cinder-74915 Sep 01 18:16:25.025967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-37c34495-a8eb-4fb1-a9fc-08a8eee7ec0d req-c5c2f00c-29b5-4dbd-ab81-80c37be78a85 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033271 Sep 01 18:16:25.026702 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 467/948] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:16:26.002247 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:26.002987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:26.009831 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:26.010354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:26.016487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:26.016487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:26.016487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:26.016487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:26.044227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:26.044725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:26.045193 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:26.045694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lazy-loading 'fault' on Instance uuid 62f037dc-fe5b-4c8a-9e5d-faa28369c547 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:16:26.085661 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:26.094075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6bcec80f-87c0-47a1-bd39-c50ec032008c tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 200 len: 1231 microversion: 2.1 time: 0.095626 Sep 01 18:16:26.094630 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 482/949] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:25 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:27.118725 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:27.120415 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 62f037dc-fe5b-4c8a-9e5d-faa28369c547] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:27.128703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:27.129473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:27.130285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:27.131029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:27.131487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:27.131919 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:27.148943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] HTTP exception thrown: Instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 could not be found. Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Request method failure captured: Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 HTTP/1.1 Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPR5GS1enotP7czfLyuHDaXbJqEWcFvtDm12MlOW0r33O1o8mH677DHQ8LiFNqG4NnzbKmyYZkds2hq7uu9kVcxohcBcGUIzLot3wTDKmllqU_iEJa6MDWXxWuJnkBFN-ittR7Sv2vgjyZTV-MMT2s2R1oPOq05rDJk6T6YK5O9sbcs Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:16:27.150722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ca8eec30c0b4a659620b6f45bb94db9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 14bd04e951254ec5bc29999bceeea214 Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 could not be found. Sep 01 18:16:27.159550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '62f037dc-fe5b-4c8a-9e5d-faa28369c547'} Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 could not be found. Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:16:27.160798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 could not be found. Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 could not be found. Sep 01 18:16:27.162390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:27.163567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Returning 404 to user: Instance 62f037dc-fe5b-4c8a-9e5d-faa28369c547 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:16:27.163567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-36faefd5-8fec-4cdb-9efc-d3700c4522ac tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547" status: 404 len: 111 microversion: 2.1 time: 0.040690 Sep 01 18:16:27.163567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 468/950] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:27 2022] GET /compute/v2.1/servers/62f037dc-fe5b-4c8a-9e5d-faa28369c547 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 18:16:34.747057 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:34.747932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:34.750623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-5fb82b58-43fd-47a5-8e58-9fe451d71795 req-95c3ef45-3d42-4f2f-9ebd-6fafa1b1a652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6059fd67-fbd2-436e-9ee1-83a607d32316", "tag": "a83e70aa-4123-44e1-b5e4-9dae2ea589ec"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:16:34.754670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:34.755162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:34.755600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:34.756303 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:34.756778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:34.757201 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:34.761292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-5fb82b58-43fd-47a5-8e58-9fe451d71795 req-95c3ef45-3d42-4f2f-9ebd-6fafa1b1a652 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:34.762011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-5fb82b58-43fd-47a5-8e58-9fe451d71795 req-95c3ef45-3d42-4f2f-9ebd-6fafa1b1a652 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:34.762569 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-5fb82b58-43fd-47a5-8e58-9fe451d71795 req-95c3ef45-3d42-4f2f-9ebd-6fafa1b1a652 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:34.775303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-5fb82b58-43fd-47a5-8e58-9fe451d71795 req-95c3ef45-3d42-4f2f-9ebd-6fafa1b1a652 service nova] Creating event network-changed:a83e70aa-4123-44e1-b5e4-9dae2ea589ec for instance 6059fd67-fbd2-436e-9ee1-83a607d32316 on hv-cinder-74915 Sep 01 18:16:34.781683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-5fb82b58-43fd-47a5-8e58-9fe451d71795 req-95c3ef45-3d42-4f2f-9ebd-6fafa1b1a652 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035041 Sep 01 18:16:34.782984 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 469/951] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:16:34.785001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:16:35.126424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-387c963f-18c7-4416-bd35-0db5ea98dc53 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 204 len: 0 microversion: 2.1 time: 0.381949 Sep 01 18:16:35.127473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 483/952] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:16:34 2022] DELETE /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:16:35.137088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:35.138698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:35.145606 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:35.146085 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:35.146521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:35.147216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:35.147666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:35.148084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:35.286719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:35.294824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-221cc0ec-e6eb-491f-b199-f9d0c5d55c5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1579 microversion: 2.1 time: 0.162085 Sep 01 18:16:35.295393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 470/953] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:35 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:16:36.315643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:36.316359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:36.323052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:36.323534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:36.323967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:36.324838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:36.325800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:36.326226 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:36.454461 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:36.462218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ea9cd845-765a-4ff7-986c-9f7969e74665 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1579 microversion: 2.1 time: 0.150794 Sep 01 18:16:36.462783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 484/954] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:36 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:37.485642 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:37.486803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:37.494574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:37.495002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:37.495438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:37.496139 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:37.496624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:37.497133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:37.626110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:37.633740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a0644eb4-c5a7-45e9-ba1d-0ead5400d2a2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1579 microversion: 2.1 time: 0.154391 Sep 01 18:16:37.634297 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 471/955] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:37 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:38.654776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:38.655384 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:38.661800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:38.662547 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:38.662989 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:38.663695 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:38.664132 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:38.664586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:38.796667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:38.804236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-688cd250-867a-41bd-89b7-b105b7c1c4e5 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1460 microversion: 2.1 time: 0.153499 Sep 01 18:16:38.804817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 485/956] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:38 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:39.825783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:39.827153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:39.834424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:39.834994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:39.835514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:39.836303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:39.836979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:39.837532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:39.898313 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-ea5a8db1-751d-4452-a032-63671b8f8fdc req-ba852b62-7c14-4dbc-b075-1823a2de2c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6059fd67-fbd2-436e-9ee1-83a607d32316", "name": "network-vif-deleted", "tag": "a83e70aa-4123-44e1-b5e4-9dae2ea589ec"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:16:39.908799 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ea5a8db1-751d-4452-a032-63671b8f8fdc req-ba852b62-7c14-4dbc-b075-1823a2de2c27 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:39.909279 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ea5a8db1-751d-4452-a032-63671b8f8fdc req-ba852b62-7c14-4dbc-b075-1823a2de2c27 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:39.909715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ea5a8db1-751d-4452-a032-63671b8f8fdc req-ba852b62-7c14-4dbc-b075-1823a2de2c27 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:39.913360 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:39.921500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-ea5a8db1-751d-4452-a032-63671b8f8fdc req-ba852b62-7c14-4dbc-b075-1823a2de2c27 service nova] Creating event network-vif-deleted:a83e70aa-4123-44e1-b5e4-9dae2ea589ec for instance 6059fd67-fbd2-436e-9ee1-83a607d32316 on hv-cinder-74915 Sep 01 18:16:39.922387 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f290bbca-252a-407b-ba39-a4d4c1bfe933 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1392 microversion: 2.1 time: 0.100713 Sep 01 18:16:39.922960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 472/957] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:39 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1392 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:39.938659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-ea5a8db1-751d-4452-a032-63671b8f8fdc req-ba852b62-7c14-4dbc-b075-1823a2de2c27 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046247 Sep 01 18:16:39.939356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 486/958] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:16:40.943158 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:40.943836 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:40.950207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:40.951673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:40.951673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:40.952341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:40.952803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:40.953230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:40.989059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:40.989059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:40.989059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:40.989059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lazy-loading 'fault' on Instance uuid 6059fd67-fbd2-436e-9ee1-83a607d32316 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:16:41.028087 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14bd04e951254ec5bc29999bceeea214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca8eec30c0b4a659620b6f45bb94db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:41.036673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e32e451a-3d80-449f-9f74-9248bee19291 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 200 len: 1231 microversion: 2.1 time: 0.097488 Sep 01 18:16:41.037243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 473/959] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:40 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:42.059073 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:42.059753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: 6059fd67-fbd2-436e-9ee1-83a607d32316] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:42.066000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:42.066480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:42.066910 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:42.067593 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:42.068050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:42.068505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:42.081513 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] HTTP exception thrown: Instance 6059fd67-fbd2-436e-9ee1-83a607d32316 could not be found. Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Request method failure captured: Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 HTTP/1.1 Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPR5GS1enotP7czfLyuHDaXbJqEWcFvtDm12MlOW0r33O1o8mH677DHQ8LiFNqG4NnzbKmyYZkds2hq7uu9kVcxohcBcGUIzLot3wTDKmllqU_iEJa6MDWXxWuJnkBFN-ittR7Sv2vgjyZTV-MMT2s2R1oPOq05rDJk6T6YK5O9sbcs Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:16:42.083120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ca8eec30c0b4a659620b6f45bb94db9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 14bd04e951254ec5bc29999bceeea214 Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 6059fd67-fbd2-436e-9ee1-83a607d32316 could not be found. Sep 01 18:16:42.087565 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '6059fd67-fbd2-436e-9ee1-83a607d32316'} Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6059fd67-fbd2-436e-9ee1-83a607d32316 could not be found. Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:16:42.088583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6059fd67-fbd2-436e-9ee1-83a607d32316 could not be found. Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6059fd67-fbd2-436e-9ee1-83a607d32316 could not be found. Sep 01 18:16:42.090402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.093127 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Returning 404 to user: Instance 6059fd67-fbd2-436e-9ee1-83a607d32316 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:16:42.093127 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-adeec248-0d4d-4ce0-822a-4decd8a8f879 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316" status: 404 len: 111 microversion: 2.1 time: 0.030170 Sep 01 18:16:42.093127 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 487/960] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:42 2022] GET /compute/v2.1/servers/6059fd67-fbd2-436e-9ee1-83a607d32316 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:16:42.593849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:42.594375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:42.600791 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:42.601262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:42.601691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:42.602369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:42.602813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:42.603279 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:42.616422 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] HTTP exception thrown: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Request method failure captured: Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: DELETE /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 HTTP/1.1 Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPR5GS1enotP7czfLyuHDaXbJqEWcFvtDm12MlOW0r33O1o8mH677DHQ8LiFNqG4NnzbKmyYZkds2hq7uu9kVcxohcBcGUIzLot3wTDKmllqU_iEJa6MDWXxWuJnkBFN-ittR7Sv2vgjyZTV-MMT2s2R1oPOq05rDJk6T6YK5O9sbcs Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:16:42.618051 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ca8eec30c0b4a659620b6f45bb94db9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 14bd04e951254ec5bc29999bceeea214 Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.621955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'e3334a42-c76b-45d7-871a-fe716b049f47'} Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:16:42.623594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.625313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.626818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Returning 404 to user: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:16:42.626818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3f8c4f0c-90fc-46ea-a8fd-ec70ddb61c6a tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 404 len: 111 microversion: 2.1 time: 0.030402 Sep 01 18:16:42.626818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 474/961] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:16:42 2022] DELETE /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 18:16:42.628212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:42.628847 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] [instance: e3334a42-c76b-45d7-871a-fe716b049f47] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:42.634797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:42.635192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:42.635623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:42.636318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:42.636775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:42.637197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:42.650956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] HTTP exception thrown: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Request method failure captured: Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 HTTP/1.1 Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPR5GS1enotP7czfLyuHDaXbJqEWcFvtDm12MlOW0r33O1o8mH677DHQ8LiFNqG4NnzbKmyYZkds2hq7uu9kVcxohcBcGUIzLot3wTDKmllqU_iEJa6MDWXxWuJnkBFN-ittR7Sv2vgjyZTV-MMT2s2R1oPOq05rDJk6T6YK5O9sbcs Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:16:42.652471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3ca8eec30c0b4a659620b6f45bb94db9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3ca8eec30c0b4a659620b6f45bb94db9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 3ca8eec30c0b4a659620b6f45bb94db9 Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-TestVolumeBootPattern-361507241 Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 14bd04e951254ec5bc29999bceeea214 Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-TestVolumeBootPattern-361507241-project Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.655051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'e3334a42-c76b-45d7-871a-fe716b049f47'} Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:16:42.656211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. Sep 01 18:16:42.658203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:16:42.659623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Returning 404 to user: Instance e3334a42-c76b-45d7-871a-fe716b049f47 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:16:42.659623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dbb277aa-2c04-41e3-8239-aa96694ddd5f tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47" status: 404 len: 111 microversion: 2.1 time: 0.029481 Sep 01 18:16:42.659623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 488/962] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:42 2022] GET /compute/v2.1/servers/e3334a42-c76b-45d7-871a-fe716b049f47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:16:44.200207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-29e1129e-e228-4ad4-b331-258afe0820b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] Calling method '.version_select at 0x7f446a8a6550>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:44.318186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-29e1129e-e228-4ad4-b331-258afe0820b2 tempest-TestVolumeBootPattern-361507241 tempest-TestVolumeBootPattern-361507241-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1874762970" status: 202 len: 0 microversion: 2.1 time: 0.132049 Sep 01 18:16:44.318780 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 475/963] 10.222.0.15 () {58 vars in 1263 bytes} [Thu Sep 1 18:16:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1874762970 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:16:51.982075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:51.983347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:51.996162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:51.997652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:51.998142 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:51.998571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:51.999298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:52.000416 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:52.000800 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:52.006043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:52.094871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lazy-loading 'services' on Instance uuid 5cce0d3b-3280-47a3-a0f1-f42481c397c1 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:16:52.396202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-70065168-7c8a-423a-93f0-e3a7b5c47d36 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-volume_attachments/d6a8fa45-cd88-491b-99c9-9793c41caf1e" status: 202 len: 0 microversion: 2.1 time: 0.420036 Sep 01 18:16:52.398368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 489/964] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:16:51 2022] DELETE /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-volume_attachments/d6a8fa45-cd88-491b-99c9-9793c41caf1e => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:16:53.520979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=54 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:53.524998 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d86e2cce-beb5-4918-a055-87e94b29e429 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:16:53.526805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:16:53.533093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d86e2cce-beb5-4918-a055-87e94b29e429 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:53.533570 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d86e2cce-beb5-4918-a055-87e94b29e429 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:53.534001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d86e2cce-beb5-4918-a055-87e94b29e429 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:53.556145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d86e2cce-beb5-4918-a055-87e94b29e429 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Going to try to stop instance {{(pid=121220) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 18:16:53.772565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d86e2cce-beb5-4918-a055-87e94b29e429 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action" status: 202 len: 0 microversion: 2.1 time: 0.252913 Sep 01 18:16:53.773293 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 476/965] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:16:53 2022] POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 18:16:53.784577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:53.785879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:53.793270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:53.794003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:53.794442 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:53.795149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:53.795605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:53.796026 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:53.948468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:53.959088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7ff17254-2f45-4c19-af52-812df9107e42 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.179238 Sep 01 18:16:53.959088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 490/966] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:53 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:54.979156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:54.979882 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:54.987734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:54.988341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:54.988699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:54.989375 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:54.989824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:54.990246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:55.122822 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:55.130651 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9725e318-295c-41b5-b03e-99151889ccb9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.156293 Sep 01 18:16:55.131237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 477/967] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:54 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:56.152999 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:56.153645 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:56.161513 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:56.162178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:56.162879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:56.163556 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:56.164002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:56.164454 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:56.293018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:56.301507 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3fc5fe47-e505-4e6e-bcbf-b64086db2f78 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.152824 Sep 01 18:16:56.302138 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 491/968] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:56 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:57.324220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:57.324865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:57.331752 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:57.332227 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:57.332683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:57.333362 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:57.333835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:57.334255 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:57.462132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:57.470399 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-33a8eabf-3c42-44ef-b79b-c61aee90c4b3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.150055 Sep 01 18:16:57.470953 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 478/969] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:57 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:58.491214 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:58.492025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:58.498536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:58.499021 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:58.499639 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:58.500559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:58.501012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:58.501438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:58.634352 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:58.642017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e1042209-ce8f-4373-abd8-7e36cf8bbe25 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.154869 Sep 01 18:16:58.642583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 492/970] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:58 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:16:59.663110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:16:59.663715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:16:59.670063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:59.670539 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:59.671548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:59.672422 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:16:59.672878 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:16:59.673306 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:16:59.804764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:16:59.813281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ecd26647-4b34-481e-86ec-31675cb69e69 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.154358 Sep 01 18:16:59.819999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 479/971] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:16:59 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:17:00.836671 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:17:00.837282 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:17:00.843859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:00.844380 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:00.844822 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:00.845518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:00.845974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:00.846400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:00.977839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:17:00.985448 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c8a191f5-d69f-4e10-a180-3dbb9edda061 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.152634 Sep 01 18:17:00.986023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 493/972] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:17:00 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:17:02.006459 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:17:02.007107 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:17:02.013631 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:02.014124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:02.015140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:02.016226 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:02.016811 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:02.020412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:02.156634 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:17:02.164786 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-73f34f11-777b-4d3e-b41a-de3d1f41c081 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.162240 Sep 01 18:17:02.165432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 480/973] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:17:02 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:17:03.186404 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:17:03.187072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:17:03.193778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:03.194270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:03.194704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:03.195391 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:03.195834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:03.196248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:03.328932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:17:03.342504 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-82387837-e4de-497b-9981-9d9e5cefd1b0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1678 microversion: 2.1 time: 0.155194 Sep 01 18:17:03.344419 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 494/974] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:17:03 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:17:04.365359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:17:04.365991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:17:04.372536 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:04.373021 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:04.373445 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:04.374217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:04.374734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:04.375161 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:04.509401 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:17:04.517349 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dfb32675-8a41-4550-bde4-fb09f6054cde tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1655 microversion: 2.1 time: 0.155990 Sep 01 18:17:04.517921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 481/975] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:17:04 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:17:04.538308 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-151e3de4-65c8-45b2-87de-7e7ba9ef9bab tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:17:04.544848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-151e3de4-65c8-45b2-87de-7e7ba9ef9bab tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:04.545335 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-151e3de4-65c8-45b2-87de-7e7ba9ef9bab tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:04.545784 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-151e3de4-65c8-45b2-87de-7e7ba9ef9bab tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:04.607381 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-151e3de4-65c8-45b2-87de-7e7ba9ef9bab tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Going to try to start instance {{(pid=121221) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 18:17:04.777002 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-151e3de4-65c8-45b2-87de-7e7ba9ef9bab tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action" status: 202 len: 0 microversion: 2.1 time: 0.242591 Sep 01 18:17:04.777703 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 495/976] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:17:04 2022] POST /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:17:04.795721 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:17:04.796732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:17:04.803005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:04.803491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:04.803987 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:04.804774 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:04.805336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:04.805765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:04.959219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:17:04.967248 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d3b3d715-e33b-404c-8b24-16bfce577c77 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1664 microversion: 2.1 time: 0.175843 Sep 01 18:17:04.967862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 482/977] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:17:04 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:17:05.991846 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:17:05.992577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:17:05.998990 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:05.999470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:06.000071 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:06.000789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:06.001342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:06.001693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:06.133700 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:17:06.141389 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-724879c1-f9c8-4524-84af-ee9b5085d30d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1664 microversion: 2.1 time: 0.154347 Sep 01 18:17:06.141953 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 496/978] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:17:05 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:17:07.162365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:17:07.163223 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:17:07.169635 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:07.170115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:07.170548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:07.171283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:17:07.171735 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:17:07.172156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:17:07.301729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:17:07.309489 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-08173c6a-b92c-4e4d-889c-295544933b49 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1668 microversion: 2.1 time: 0.151005 Sep 01 18:17:07.310056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 483/979] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:17:07 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:02.719248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d7a343d8-5fe0-462b-b347-6a97bc930f12 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Action: 'create', calling method: .version_select at 0x7f446a70d820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2108266222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/9igtQIafUAaFnwYTVGYXyM2CoPl1ydCFRixLXcC2fI1G3pO1e2dJHo1CgpUOaSzsXdGoQ82JmLqLtAz4pm0yPvwvgDAQVIIzPDiIDYqaaEbdWl+XEMgLuSdjmuiJBQQ=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:02.724865 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=15 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:02.725525 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:02.727126 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:18:02.727289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Thu Sep 1 18:18:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.15) !!! Sep 01 18:18:02.740933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-d7a343d8-5fe0-462b-b347-6a97bc930f12 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Getting quotas for project a2d986195f844099b8616c92bc2162b4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:18:02.744785 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-d7a343d8-5fe0-462b-b347-6a97bc930f12 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Getting quotas for user 9d20630980d642fa90636ff4c2d67075 and project a2d986195f844099b8616c92bc2162b4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:18:02.825903 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d7a343d8-5fe0-462b-b347-6a97bc930f12 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.110927 Sep 01 18:18:02.826558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 497/980] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:18:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:02.877993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1339750054", "imageRef": "54a3a55f-c852-4610-b058-a64352f0990f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2108266222", "networks": [{"uuid": "72be5aa1-d4ce-45e5-852b-cfd5b83e5b85"}]}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:02.886543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=15 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:02.887202 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:02.888226 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:18:02.888402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Thu Sep 1 18:18:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Sep 01 18:18:02.937491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] validate_networks() for [('72be5aa1-d4ce-45e5-852b-cfd5b83e5b85', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:18:03.405783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:18:03.406227 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:18:03.406689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:18:03.407090 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:18:03.407491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:18:03.416518 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:03.417018 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:03.417449 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:03.418160 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:03.418606 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:03.419021 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:03.435611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Getting quotas for project a2d986195f844099b8616c92bc2162b4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:18:03.439534 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Getting quotas for user 9d20630980d642fa90636ff4c2d67075 and project a2d986195f844099b8616c92bc2162b4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:18:03.450151 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:18:03.452348 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='54a3a55f-c852-4610-b058-a64352f0990f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:18:03.615874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-752d6be4-f5e7-4d0c-8c6a-6b9e048e95c7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742536 Sep 01 18:18:03.616549 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 484/981] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 18:18:03.627693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e5651c2-a72c-441c-9a2d-996e5a51919d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:03.628534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8e5651c2-a72c-441c-9a2d-996e5a51919d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:03.687429 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8e5651c2-a72c-441c-9a2d-996e5a51919d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:03.689822 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8e5651c2-a72c-441c-9a2d-996e5a51919d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1259 microversion: 2.1 time: 0.066628 Sep 01 18:18:03.690512 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 498/982] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:03 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:04.711491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:04.712038 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:04.719337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:04.719814 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:04.720240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:04.721002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:04.721442 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:04.728616 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:04.783209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:04.791137 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-076df91a-10a9-4d1f-8702-47a728187129 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1263 microversion: 2.1 time: 0.084491 Sep 01 18:18:04.797583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 485/983] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:04 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:05.812856 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:05.813375 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:05.820082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:05.820592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:05.821028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:05.821719 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:05.822168 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:05.822591 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:05.883819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:05.892257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f1d06f1e-238e-4157-b5db-c5329146a5fa tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1311 microversion: 2.1 time: 0.084301 Sep 01 18:18:05.892855 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 499/984] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:05 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:06.235720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:06.239123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:06.245743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.246734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.247371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:06.248283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.248756 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.249938 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:06.281370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-17656aa9-733c-4f5e-acba-c5d61a490479 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050238 Sep 01 18:18:06.281949 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 486/985] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:18:06 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:18:06.346104 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:06.346104 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:06.350715 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.351197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.351658 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:06.352372 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.352822 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.353246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:06.382394 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:18:06.750790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eb29f6ac-0d36-4a6f-9371-b008ed44caae tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 204 len: 0 microversion: 2.1 time: 0.411125 Sep 01 18:18:06.751425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 500/986] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:18:06 2022] DELETE /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:18:06.762341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:06.762341 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:06.767101 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.767652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.768040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:06.768787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.769243 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.769663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:06.914013 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:06.914712 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:06.921569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.922319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.922913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:06.923851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:06.924339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:06.924765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:07.008723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:07.019696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e355193d-29af-49de-a481-141bce3b4693 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.263983 Sep 01 18:18:07.020286 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 487/987] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:06 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:07.094989 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:07.103133 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-63ae1dc2-2807-4621-8c75-1fe19bc1d33d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.193629 Sep 01 18:18:07.103713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 501/988] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:06 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:08.042990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:08.044507 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:08.053757 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:08.054551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:08.055151 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:08.055854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:08.056298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:08.056990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:08.124774 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:08.125580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:08.131912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:08.132434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:08.132879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:08.133577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:08.134025 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:08.134449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:08.204941 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:08.214206 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7c53235d-76e9-41eb-a350-c6a6ef097f26 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.176320 Sep 01 18:18:08.214772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 488/989] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:08 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:08.283519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:08.293428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7c15b8b0-393b-4194-8e9e-6a8c3b819d54 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.172946 Sep 01 18:18:08.293940 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 502/990] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:08 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:09.235192 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:09.236532 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:09.243454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:09.244724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:09.252464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:09.252464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:09.252464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:09.252464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:09.315898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:09.317180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:09.324604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:09.327575 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:09.327575 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:09.327575 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:09.327575 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:09.328459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:09.416360 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:09.424871 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e6b15217-bfa2-466c-be65-a359d36c626a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.193682 Sep 01 18:18:09.425824 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 489/991] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:09 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:09.481959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:09.492434 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1085ee7f-b78c-493e-97e6-17559abb643f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.181650 Sep 01 18:18:09.493396 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 503/992] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:09 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:10.446584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:10.447188 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:10.453582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:10.454063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:10.454494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:10.455177 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:10.455623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:10.456041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:10.514362 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:10.514918 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:10.522679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:10.523330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:10.523837 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:10.524641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:10.525359 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:10.525861 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:10.612422 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:10.620755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-30584a0f-fb45-4761-a768-8f49d621f995 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.177938 Sep 01 18:18:10.621339 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 490/993] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:10 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:10.685452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:10.694158 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cc3f44b2-3842-4d07-aae4-718a9374716f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.183873 Sep 01 18:18:10.694725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 504/994] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:10 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:11.643207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:11.643820 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:11.650628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:11.651119 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:11.651545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:11.652371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:11.652848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:11.653266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:11.715250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:11.716604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:11.724092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:11.725160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:11.725160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:11.725711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:11.726154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:11.726570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:11.810957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:11.830935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7c0f500a-4a5e-483b-8898-e3f0534f2ad1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.191534 Sep 01 18:18:11.831810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 491/995] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:11 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:11.894116 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:11.902234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2d8f5f3d-c892-4cfd-addb-e2ae9527b644 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.190920 Sep 01 18:18:11.902897 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 505/996] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:11 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:12.855080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:12.855707 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:12.862996 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:12.863483 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:12.863914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:12.864637 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:12.865092 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:12.865529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:12.923614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:12.925845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:12.932502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:12.933334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:12.933826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:12.934756 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:12.935587 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:12.936108 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:13.021407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:13.029269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3c8a1e1d-5d63-4c80-93da-80c1d32fc29c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.180024 Sep 01 18:18:13.030661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 492/997] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:12 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:13.096899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:13.105560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aa1195a3-7445-41d3-8a05-b3604cfbc22d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.185657 Sep 01 18:18:13.106080 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 506/998] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:12 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:14.053396 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:14.054617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:14.056535 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:14.057662 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:14.063614 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:14.064149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:14.070292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:14.070292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:14.070292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:14.070292 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:14.134535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:14.135452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:14.137797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:14.144088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:14.144597 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:14.145031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:14.145732 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:14.146178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:14.146601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:14.234262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:14.247983 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a12345ee-93e7-429a-b8f6-5554c00c55f4 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.200071 Sep 01 18:18:14.265698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 493/999] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:14 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:14.447789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:14.456813 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b527f047-11e6-4ab6-a881-c25cbad2b1cc tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.327768 Sep 01 18:18:14.457615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 507/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:14 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:15.270749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:15.271356 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:15.277963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:15.278439 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:15.278866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:15.279557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:15.280675 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:15.281098 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:15.423433 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:15.431453 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-06eaecf1-20a6-4988-9367-9e1956de9f45 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.164525 Sep 01 18:18:15.432031 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 494/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:15 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:15.477262 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:15.477858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:15.484247 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:15.484747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:15.485169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:15.486028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:15.486470 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:15.487124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:15.628633 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:15.636476 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f25bb923-c9d6-4dfb-9449-036ffeddd1eb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.162956 Sep 01 18:18:15.637174 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 508/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:15 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:16.455328 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:16.455935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:16.462389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:16.462951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:16.463288 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:16.463981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:16.464456 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:16.464883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:16.591878 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:16.599677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e5b7a5ce-a07c-4771-b415-771380869a6e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.148467 Sep 01 18:18:16.600237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 495/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:16 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:16.658099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:16.665086 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:16.665458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:16.665935 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:16.666366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:16.667048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:16.667498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:16.667919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:16.793553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:16.801959 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0ef77929-4030-4f46-85e8-bb1a531f3808 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.147789 Sep 01 18:18:16.802519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 509/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:16 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:17.622371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:17.622966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:17.629853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:17.630336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:17.630771 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:17.631606 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:17.632056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:17.632514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:17.760576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:17.768975 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a4e9ffbc-1c4b-4bf4-91df-480f4ae7c6cf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.150622 Sep 01 18:18:17.769551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 496/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:17 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:17.822402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:17.823036 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:17.830339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:17.831093 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:17.831524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:17.832236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:17.832709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:17.833127 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:17.962388 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:17.970755 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-dbb09a68-7147-4126-b19d-e87f9259a607 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.152115 Sep 01 18:18:17.971327 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 510/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:17 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:18.790123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:18.790729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:18.797567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:18.798096 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:18.798524 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:18.799252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:18.799657 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:18.800077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:18.932272 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:18.940442 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fde2160f-b5cc-4239-86db-1e5d653a464a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.154483 Sep 01 18:18:18.941009 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 497/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:18 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:18.993423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:18.994024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:19.000869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:19.001342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:19.001763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:19.002439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:19.002880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:19.003295 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:19.136022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:19.143245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e0d61b8d-7614-4c44-bebb-c58abba43bf7 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.153632 Sep 01 18:18:19.143798 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 511/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:18 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:19.962545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:19.963153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:19.970835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:19.971324 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:19.971775 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:19.972559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:19.973014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:19.973442 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:20.164967 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:20.165507 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:20.171469 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:20.174398 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:20.174398 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:20.174398 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:20.174398 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:20.174830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:20.290344 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:20.299695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fccdf8c2-74f1-4b46-ac8d-6830e70a6646 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1674 microversion: 2.1 time: 0.340975 Sep 01 18:18:20.300276 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 498/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:19 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1674 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:20.334289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:20.342091 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-614bbce2-5d48-4f9d-acf1-0b57f357cb1b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.181915 Sep 01 18:18:20.342656 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 512/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:20 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:20.724533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-c160c505-bf87-43d5-9fd2-e4663c60637a req-ba660ce5-7641-4484-9ca2-dd7630232fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad556ce-b187-4bec-a1ee-88445047c88e", "tag": "02aad05c-d44e-461e-87bc-9b9f57c7ae11"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:20.734217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c160c505-bf87-43d5-9fd2-e4663c60637a req-ba660ce5-7641-4484-9ca2-dd7630232fbb service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:20.734696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c160c505-bf87-43d5-9fd2-e4663c60637a req-ba660ce5-7641-4484-9ca2-dd7630232fbb service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:20.735441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-c160c505-bf87-43d5-9fd2-e4663c60637a req-ba660ce5-7641-4484-9ca2-dd7630232fbb service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:20.747322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-c160c505-bf87-43d5-9fd2-e4663c60637a req-ba660ce5-7641-4484-9ca2-dd7630232fbb service nova] Creating event network-changed:02aad05c-d44e-461e-87bc-9b9f57c7ae11 for instance aad556ce-b187-4bec-a1ee-88445047c88e on hv-cinder-74915 Sep 01 18:18:20.753053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-c160c505-bf87-43d5-9fd2-e4663c60637a req-ba660ce5-7641-4484-9ca2-dd7630232fbb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032473 Sep 01 18:18:20.753799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 499/1011] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:21.322437 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:21.323356 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:21.330788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:21.331422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:21.331962 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:21.333123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:21.333932 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:21.334481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:21.365666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:21.366517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:21.377052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:21.380209 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:21.380840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:21.386970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:21.387881 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:21.389099 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:21.449512 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:21.453650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:21.458761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2f0649dd-5851-4310-93b7-4ffcf3fddfaf tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1606 microversion: 2.1 time: 0.140417 Sep 01 18:18:21.459827 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 513/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:21 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1606 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:21.605096 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:21.613921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c9a1d8ba-373d-4d58-a8ed-738e7772f8b8 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.254425 Sep 01 18:18:21.614799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 500/1013] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:21 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:22.480995 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:22.487014 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:22.489226 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:22.489877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:22.490349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:22.491153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:22.491601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:22.492017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:22.523083 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:22.523543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:22.523963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:22.524459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lazy-loading 'fault' on Instance uuid 5cce0d3b-3280-47a3-a0f1-f42481c397c1 {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:18:22.565611 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:22.573096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-51060633-5ae4-46e1-ad79-96ae29fbf0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1327 microversion: 2.1 time: 0.096090 Sep 01 18:18:22.573648 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 514/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:22 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:22.642468 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:22.643082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:22.649529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:22.650007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:22.650443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:22.651132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:22.651589 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:22.652014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:22.770096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-4653c4f6-1da6-4ddb-8397-3c4fa80e37a3 req-0f4314ce-5a2c-49e2-afbc-e4b892bc6413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cce0d3b-3280-47a3-a0f1-f42481c397c1", "name": "network-vif-deleted", "tag": "edb2da5c-9a4c-4600-85b0-5be3d2a1f983"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:22.779247 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-4653c4f6-1da6-4ddb-8397-3c4fa80e37a3 req-0f4314ce-5a2c-49e2-afbc-e4b892bc6413 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:22.779721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-4653c4f6-1da6-4ddb-8397-3c4fa80e37a3 req-0f4314ce-5a2c-49e2-afbc-e4b892bc6413 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:22.780145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-4653c4f6-1da6-4ddb-8397-3c4fa80e37a3 req-0f4314ce-5a2c-49e2-afbc-e4b892bc6413 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:22.783323 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:22.787012 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=100 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:22.791828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-faf75ba5-8d03-4de6-a73a-45102cfc5729 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.153338 Sep 01 18:18:22.791974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-4653c4f6-1da6-4ddb-8397-3c4fa80e37a3 req-0f4314ce-5a2c-49e2-afbc-e4b892bc6413 service nova] Creating event network-vif-deleted:edb2da5c-9a4c-4600-85b0-5be3d2a1f983 for instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 on hv-cinder-74915 Sep 01 18:18:22.792415 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 501/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:22 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:22.798045 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-4653c4f6-1da6-4ddb-8397-3c4fa80e37a3 req-0f4314ce-5a2c-49e2-afbc-e4b892bc6413 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Sep 01 18:18:22.798621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 515/1016] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:18:23.594497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:23.595108 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:23.601497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:23.601981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:23.602420 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:23.603113 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:23.603567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:23.603992 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:23.634462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:23.634937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:23.635371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:23.635813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lazy-loading 'fault' on Instance uuid 5cce0d3b-3280-47a3-a0f1-f42481c397c1 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:18:23.675462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:23.682996 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-73fdeaf8-d24c-4dab-9e76-f5310302c79a tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 200 len: 1327 microversion: 2.1 time: 0.092679 Sep 01 18:18:23.683554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 502/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:23 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:23.814436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:23.815133 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:23.821823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:23.822306 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:23.822744 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:23.823436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:23.823892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:23.824337 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:23.978675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:23.986701 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-af23debe-3e15-4e42-8b00-fc54dbaaba33 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.177047 Sep 01 18:18:23.987256 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 516/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:23 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:24.704513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:24.705153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:24.711665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:24.712141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:24.712612 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:24.713299 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:24.713749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:24.714171 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:24.728275 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] HTTP exception thrown: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Request method failure captured: Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 HTTP/1.1 Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPYUDVXrRIxVbEbbZmNvFFcgOO3rWSzUccFG4G_d-MYowLeC9-YhqI3T8OMjv-n-V-J9E3XOdkWEBC4qWep3jKBpXo21O3nLCJ4cnTesyXiaqVQR8uF6sVvy2dyGKgPCbjAZxP7hziMmr5Y_FJdSyZ-qYLAS5u_1lP54Ea0crlx86_U Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:18:24.729913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1c789d40f8a84058a49533d382fe5303", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: f747a57b1a604347b9d2828bdddfa0e9 Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:18:24.731629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '5cce0d3b-3280-47a3-a0f1-f42481c397c1'} Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:18:24.732896 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:18:24.734935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:18:24.736480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Returning 404 to user: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:18:24.736480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-12a00b68-6021-4a8b-a048-540c95981fe0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 404 len: 111 microversion: 2.1 time: 0.031215 Sep 01 18:18:24.736480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 503/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:24 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:18:24.740979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e628d7a-6e84-4c0d-839e-aae8ad1f96b7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '.version_select at 0x7f446a6dcaf0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:24.847884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8e628d7a-6e84-4c0d-839e-aae8ad1f96b7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993609111" status: 202 len: 0 microversion: 2.1 time: 0.111211 Sep 01 18:18:24.848574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 517/1020] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 1 18:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993609111 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:18:25.006943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:25.007549 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:25.013843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:25.014326 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:25.014755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:25.015526 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:25.016671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:25.017034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:25.167602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:25.177985 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7d002732-bb52-4f5f-8c07-b60f1aa07c4b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.174896 Sep 01 18:18:25.181162 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 504/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:25 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:25.621986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-800c54c7-3086-4182-88a3-fa558671d13c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'create', calling method: .version_select at 0x7f446a6a43a0>, body: {"keypair": {"name": "tempest-keypair-1981148502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeayPhvEL7Sum7MZFXSGluq+fUkF0S/AjRGVrnT99rUmQuWX6tF97vHgogsxuFO83Gvdh+FwJpo3bOKcUjZDHjVJ8Ir8A+nRsHp/3ZM20N1oKUqfjPCbeQ7G0H6KL7snQ=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:25.638731 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-800c54c7-3086-4182-88a3-fa558671d13c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for project 1c789d40f8a84058a49533d382fe5303. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:18:25.642457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-800c54c7-3086-4182-88a3-fa558671d13c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for user f747a57b1a604347b9d2828bdddfa0e9 and project 1c789d40f8a84058a49533d382fe5303. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:18:25.723227 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-800c54c7-3086-4182-88a3-fa558671d13c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105260 Sep 01 18:18:25.723820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 518/1022] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:18:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:26.199682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:26.200376 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:26.207503 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:26.207982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:26.208438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:26.209136 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:26.209582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:26.210010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:26.342492 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:26.350931 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7fbae670-ca72-4b3c-9bf4-e81f4cc22024 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.155459 Sep 01 18:18:26.351493 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 505/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:26 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:27.365498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-9f5c923b-1881-4f13-8d28-7a0d9079cc73 req-e4eef538-42f7-4de5-8bbf-cf14790e1e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad556ce-b187-4bec-a1ee-88445047c88e", "name": "network-vif-plugged", "status": "completed", "tag": "02aad05c-d44e-461e-87bc-9b9f57c7ae11"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:27.374068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:27.375344 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:27.390037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:27.390868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:27.391686 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:27.392474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:27.392941 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:27.393378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:27.401930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9f5c923b-1881-4f13-8d28-7a0d9079cc73 req-e4eef538-42f7-4de5-8bbf-cf14790e1e36 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:27.402331 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9f5c923b-1881-4f13-8d28-7a0d9079cc73 req-e4eef538-42f7-4de5-8bbf-cf14790e1e36 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:27.402763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9f5c923b-1881-4f13-8d28-7a0d9079cc73 req-e4eef538-42f7-4de5-8bbf-cf14790e1e36 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:27.425327 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-9f5c923b-1881-4f13-8d28-7a0d9079cc73 req-e4eef538-42f7-4de5-8bbf-cf14790e1e36 service nova] Creating event network-vif-plugged:02aad05c-d44e-461e-87bc-9b9f57c7ae11 for instance aad556ce-b187-4bec-a1ee-88445047c88e on hv-cinder-74915 Sep 01 18:18:27.438713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-9f5c923b-1881-4f13-8d28-7a0d9079cc73 req-e4eef538-42f7-4de5-8bbf-cf14790e1e36 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255979 Sep 01 18:18:27.442762 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 519/1024] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:27.556636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:27.565117 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6b735632-1ce1-43b2-bf24-9d62aea497b0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.195349 Sep 01 18:18:27.565691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 506/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:27 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:28.020651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1273175906", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc156a6a-c1da-4b16-9e79-62956f265b52"}], "security_groups": [{"name": "tempest-securitygroup--1206749898"}], "key_name": "tempest-keypair-1981148502", "user_data": "}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:28.121051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] validate_networks() for [('dc156a6a-c1da-4b16-9e79-62956f265b52', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:18:28.543046 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:18:28.543625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:18:28.543922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:18:28.544385 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:18:28.544793 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:18:28.554048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:28.554521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:28.554951 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:28.555663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:28.556109 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:28.556554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:28.573450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for project 1c789d40f8a84058a49533d382fe5303. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:18:28.577304 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Getting quotas for user f747a57b1a604347b9d2828bdddfa0e9 and project 1c789d40f8a84058a49533d382fe5303. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:18:28.588302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:28.588924 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:18:28.589411 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:28.591255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:18:28.598715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:28.599198 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:28.599632 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:28.600354 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:28.600808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:28.601233 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:28.731351 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:28.736043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-20284516-4349-4073-8113-8214f6c45000 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.720764 Sep 01 18:18:28.736868 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 520/1026] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:18:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:18:28.741344 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7d639b7d-ff4a-4918-a512-06815ecf99b5 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1359 microversion: 2.1 time: 0.158060 Sep 01 18:18:28.752386 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 507/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:28 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:28.755560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-190194ab-a47b-4fde-9e59-e1da1d70d0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:28.755560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-190194ab-a47b-4fde-9e59-e1da1d70d0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:28.758032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:28.804277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-190194ab-a47b-4fde-9e59-e1da1d70d0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:28.810990 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-190194ab-a47b-4fde-9e59-e1da1d70d0d3 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1238 microversion: 2.1 time: 0.067427 Sep 01 18:18:28.812897 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 521/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:28 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:29.763129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:29.763656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:29.771075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:29.771689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:29.772110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:29.772834 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:29.773685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:29.778520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:29.832776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:29.833526 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:29.840513 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:29.841545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:29.841545 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:29.842102 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:29.842564 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:29.842977 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:29.910269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:29.911942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:29.919436 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b6f40a58-efe6-4d86-aa1a-51d3b9af3207 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1242 microversion: 2.1 time: 0.091708 Sep 01 18:18:29.920052 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 522/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:29 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:29.920192 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-65ba3928-2561-4e34-98db-b40e45bacfda tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1550 microversion: 2.1 time: 0.160853 Sep 01 18:18:29.920965 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 508/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:29 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:29.941668 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:29.943741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:29.957225 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:29.957706 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:29.958136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:29.958830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:29.959272 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:29.959693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:30.097485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:30.105072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7ab1bc8b-8fd6-48b4-a0f5-17e67ec17bbf tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1550 microversion: 2.1 time: 0.168244 Sep 01 18:18:30.105621 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 523/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:29 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:30.124338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:30.129246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:30.129999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Searching by: {'deleted': False, 'project_id': 'a2d986195f844099b8616c92bc2162b4'} {{(pid=121220) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 18:18:30.136566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:30.137040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:30.137466 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:30.138181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:30.138624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:30.139039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:30.231105 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.multi_cell_list [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121220) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 18:18:30.328703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e242dadf-afee-4956-ae35-06524c33fef3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207393 Sep 01 18:18:30.329208 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 509/1032] 10.222.0.15 () {58 vars in 1125 bytes} [Thu Sep 1 18:18:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:30.340152 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:30.340778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:30.346884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:30.347361 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:30.347795 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:30.348514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:30.348968 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:30.349390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:30.475895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:30.483671 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-26707266-eefa-4bb7-9131-7506489d5bf6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1550 microversion: 2.1 time: 0.147296 Sep 01 18:18:30.484257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 524/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:30 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:30.945029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:30.945619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:30.952389 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:30.953101 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:30.953635 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:30.957034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:30.957034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:30.957034 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:31.062772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:31.071109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9a5879f1-381a-45c7-94a4-01111f47b29e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1308 microversion: 2.1 time: 0.129956 Sep 01 18:18:31.071849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 510/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:30 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:32.092752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:32.094171 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:32.101598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:32.102353 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:32.102956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:32.103757 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:32.104211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:32.104706 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:32.249009 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:32.257313 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f5771765-b393-42e3-a654-c8a1a1f22164 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.169102 Sep 01 18:18:32.257957 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 525/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:32 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:32.327150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c179053-9b9a-4b11-a093-f930a6a83a92"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:32.327721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-8df38e33-3f48-401e-93e2-f35d0174f15e req-b4f3f857-2e8f-4450-8d90-c0342a50a9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94cd81f-a7cd-448c-88f4-f3a5c335ecc7", "tag": "c64f2d09-215c-4500-9f06-abf7769366e6"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:32.330443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:32.337104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:32.337450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8df38e33-3f48-401e-93e2-f35d0174f15e req-b4f3f857-2e8f-4450-8d90-c0342a50a9df service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:32.337571 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:32.337925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8df38e33-3f48-401e-93e2-f35d0174f15e req-b4f3f857-2e8f-4450-8d90-c0342a50a9df service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:32.338053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:32.338346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-8df38e33-3f48-401e-93e2-f35d0174f15e req-b4f3f857-2e8f-4450-8d90-c0342a50a9df service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:32.338670 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:32.339110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:32.339525 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:32.352378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-8df38e33-3f48-401e-93e2-f35d0174f15e req-b4f3f857-2e8f-4450-8d90-c0342a50a9df service nova] Creating event network-changed:c64f2d09-215c-4500-9f06-abf7769366e6 for instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 on hv-cinder-74915 Sep 01 18:18:32.357467 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-8df38e33-3f48-401e-93e2-f35d0174f15e req-b4f3f857-2e8f-4450-8d90-c0342a50a9df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033787 Sep 01 18:18:32.358249 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 526/1036] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:33.023042 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-24c6867f-bee3-4045-bd0b-64f651995c1a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700094 Sep 01 18:18:33.024154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 511/1037] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:18:32 2022] POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:18:33.279778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:33.280481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:33.287291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:33.287765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:33.288191 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:33.289148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:33.289592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:33.290040 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:33.417655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:33.426054 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cdcc9bb0-7dfe-4010-a004-e10405ec114b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.151239 Sep 01 18:18:33.426618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 527/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:33 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:34.447512 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:34.448204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:34.450130 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:34.455089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:34.455567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:34.456000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:34.456719 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:34.457170 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:34.457594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:34.589412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:34.597188 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-175599ca-cf24-4185-9d1d-0a724c0d3a5c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.154402 Sep 01 18:18:34.597755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 512/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:34 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:35.619947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:35.620647 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:35.628030 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:35.632532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:35.632532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:35.632532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:35.632532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:35.632970 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:35.772631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:35.780459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4e5cca5e-b88a-478d-96bc-5baadb7810e7 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.165593 Sep 01 18:18:35.781163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 528/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:35 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:36.801327 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:36.801936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:36.808528 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:36.809010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:36.809446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:36.810143 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:36.810593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:36.811018 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:36.938415 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:36.945921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8191abd4-a2c9-4c3f-bb3a-c72cacdd53d0 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.148434 Sep 01 18:18:36.946477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 513/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:36 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:37.966427 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:37.967048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:37.973546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:37.974022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:37.974449 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:37.975130 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:37.975576 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:37.975998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:38.110906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:38.118407 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5b46597b-fc05-45d0-8b9a-17192051ffa2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.155843 Sep 01 18:18:38.118961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 529/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:37 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:39.139589 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:39.140827 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:39.147220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:39.147702 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:39.148137 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:39.148851 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:39.149304 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:39.149765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:39.287141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:39.295146 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a0afd6f2-955d-42bd-9b7f-104cb592679c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.159385 Sep 01 18:18:39.295782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 514/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:39 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:39.361089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-2962587b-8a12-407f-a205-d5c84947c0d7 req-b135120e-a748-4e3b-8fb4-090bcef757eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94cd81f-a7cd-448c-88f4-f3a5c335ecc7", "name": "network-vif-plugged", "status": "completed", "tag": "c64f2d09-215c-4500-9f06-abf7769366e6"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:39.366195 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:39.366978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=12 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:39.376219 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2962587b-8a12-407f-a205-d5c84947c0d7 req-b135120e-a748-4e3b-8fb4-090bcef757eb service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:39.376613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2962587b-8a12-407f-a205-d5c84947c0d7 req-b135120e-a748-4e3b-8fb4-090bcef757eb service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:39.377039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2962587b-8a12-407f-a205-d5c84947c0d7 req-b135120e-a748-4e3b-8fb4-090bcef757eb service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:39.388343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-2962587b-8a12-407f-a205-d5c84947c0d7 req-b135120e-a748-4e3b-8fb4-090bcef757eb service nova] Creating event network-vif-plugged:c64f2d09-215c-4500-9f06-abf7769366e6 for instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 on hv-cinder-74915 Sep 01 18:18:39.393917 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-2962587b-8a12-407f-a205-d5c84947c0d7 req-b135120e-a748-4e3b-8fb4-090bcef757eb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036739 Sep 01 18:18:39.394510 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 530/1044] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:40.321246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:40.321855 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:40.324156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:40.329798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:40.330278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:40.330755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:40.331483 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:40.331935 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:40.332406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:40.458884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:40.466479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-66f02c8c-302a-4aa1-a525-19b46e7ac14d tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.149122 Sep 01 18:18:40.467040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 515/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:40 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:41.487992 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:41.488780 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:41.495908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:41.496419 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:41.496857 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:41.497553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:41.498003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:41.498427 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:41.633415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:41.642445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9a4fbb7c-1989-4486-9511-60353575c449 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1364 microversion: 2.1 time: 0.159039 Sep 01 18:18:41.643030 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 531/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:41 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:42.662765 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:42.663382 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:42.670178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:42.673527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:42.673527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:42.673527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:42.673527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:42.673937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:42.715812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:42.716466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:42.723842 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:42.724191 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:42.724651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:42.725350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:42.725810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:42.726232 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:42.806202 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:42.814669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0661ce6c-b617-41fa-843c-1e91f8bbceb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1550 microversion: 2.1 time: 0.155721 Sep 01 18:18:42.815245 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 516/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:42 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:18:42.835722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:42.836210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:42.842127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:42.845497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:42.845497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:42.845497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:42.845497 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:42.845915 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:42.849230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:18:42.860922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:42.869459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eeb80d4a-ab0c-49ba-ba9e-e790135bfcb0 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1596 microversion: 2.1 time: 0.157434 Sep 01 18:18:42.870107 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 532/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:42 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1596 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:18:42.926608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e4f18aab-aa87-40e4-afcf-c9e60024bd48 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094668 Sep 01 18:18:42.927194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 517/1049] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:18:42 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:18:43.912008 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-73ef4f00-6379-4ce1-9efd-095c28d75e27 req-75794e4f-9d88-4e89-a2b4-931b08838ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94cd81f-a7cd-448c-88f4-f3a5c335ecc7", "tag": "c64f2d09-215c-4500-9f06-abf7769366e6"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:43.923535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-73ef4f00-6379-4ce1-9efd-095c28d75e27 req-75794e4f-9d88-4e89-a2b4-931b08838ad8 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:43.924024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-73ef4f00-6379-4ce1-9efd-095c28d75e27 req-75794e4f-9d88-4e89-a2b4-931b08838ad8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:43.924485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-73ef4f00-6379-4ce1-9efd-095c28d75e27 req-75794e4f-9d88-4e89-a2b4-931b08838ad8 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:43.936455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-73ef4f00-6379-4ce1-9efd-095c28d75e27 req-75794e4f-9d88-4e89-a2b4-931b08838ad8 service nova] Creating event network-changed:c64f2d09-215c-4500-9f06-abf7769366e6 for instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 on hv-cinder-74915 Sep 01 18:18:43.942327 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-73ef4f00-6379-4ce1-9efd-095c28d75e27 req-75794e4f-9d88-4e89-a2b4-931b08838ad8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033840 Sep 01 18:18:43.943003 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 533/1050] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:45.182995 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-cf2bbc0a-05c2-44a6-9243-324e6972a3cc req-caa0d52b-1b10-4b53-b266-2de3d6ae3766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad556ce-b187-4bec-a1ee-88445047c88e", "tag": "02aad05c-d44e-461e-87bc-9b9f57c7ae11"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:45.192994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cf2bbc0a-05c2-44a6-9243-324e6972a3cc req-caa0d52b-1b10-4b53-b266-2de3d6ae3766 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:45.193502 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cf2bbc0a-05c2-44a6-9243-324e6972a3cc req-caa0d52b-1b10-4b53-b266-2de3d6ae3766 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:45.193925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cf2bbc0a-05c2-44a6-9243-324e6972a3cc req-caa0d52b-1b10-4b53-b266-2de3d6ae3766 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:45.205030 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-cf2bbc0a-05c2-44a6-9243-324e6972a3cc req-caa0d52b-1b10-4b53-b266-2de3d6ae3766 service nova] Creating event network-changed:02aad05c-d44e-461e-87bc-9b9f57c7ae11 for instance aad556ce-b187-4bec-a1ee-88445047c88e on hv-cinder-74915 Sep 01 18:18:45.210412 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-cf2bbc0a-05c2-44a6-9243-324e6972a3cc req-caa0d52b-1b10-4b53-b266-2de3d6ae3766 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093863 Sep 01 18:18:45.211204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 518/1051] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:47.646734 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1312213951"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:47.647343 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:47.653451 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:47.653931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:47.654374 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:47.655056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:47.655553 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:47.656069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:47.780642 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.network.security_group_api [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Adding security group 5736e67a-1ceb-475f-a442-422cbd8d2c73 to port 02aad05c-d44e-461e-87bc-9b9f57c7ae11 Sep 01 18:18:48.174156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-22826270-8da9-461c-be9b-38c0c969a3d9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/action" status: 202 len: 0 microversion: 2.1 time: 0.532119 Sep 01 18:18:48.174790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 534/1052] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:18:47 2022] POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:18:48.183910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:18:48.184693 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:18:48.185539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-ac1410b8-3ec7-43f1-9dca-485501485aa2 req-5b906534-b9a9-4ca6-8c2b-0f72b761f418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad556ce-b187-4bec-a1ee-88445047c88e", "tag": "02aad05c-d44e-461e-87bc-9b9f57c7ae11"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:18:48.193256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:48.194207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:48.194877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:48.195943 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ac1410b8-3ec7-43f1-9dca-485501485aa2 req-5b906534-b9a9-4ca6-8c2b-0f72b761f418 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:48.196106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:18:48.196751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ac1410b8-3ec7-43f1-9dca-485501485aa2 req-5b906534-b9a9-4ca6-8c2b-0f72b761f418 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:48.196925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:18:48.197461 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:48.197658 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-ac1410b8-3ec7-43f1-9dca-485501485aa2 req-5b906534-b9a9-4ca6-8c2b-0f72b761f418 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:18:48.211539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-ac1410b8-3ec7-43f1-9dca-485501485aa2 req-5b906534-b9a9-4ca6-8c2b-0f72b761f418 service nova] Creating event network-changed:02aad05c-d44e-461e-87bc-9b9f57c7ae11 for instance aad556ce-b187-4bec-a1ee-88445047c88e on hv-cinder-74915 Sep 01 18:18:48.217453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-ac1410b8-3ec7-43f1-9dca-485501485aa2 req-5b906534-b9a9-4ca6-8c2b-0f72b761f418 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035347 Sep 01 18:18:48.219708 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 535/1053] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:18:48.507400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:18:48.516403 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-319fef6b-2ac6-4873-8b82-10928c0a34cb tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1762 microversion: 2.1 time: 0.337064 Sep 01 18:18:48.516977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 519/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:18:48 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1762 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:49.224438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=28 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:19:49.225151 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=86 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:19:49.230364 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:19:49.232641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:49.242324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:49.242324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:49.242324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:49.242324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:49.242748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:49.242748 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:49.485183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-eefd56ea-9c1f-4ca9-b95e-59428cacdb67 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/action" status: 202 len: 0 microversion: 2.1 time: 0.262861 Sep 01 18:19:49.485750 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 536/1055] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:19:49 2022] POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:19:49.493126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=15 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:19:49.493868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=10 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:19:49.494715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:19:49.494866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Thu Sep 1 18:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e (ip 10.222.0.15) !!! Sep 01 18:19:49.500347 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:49.504951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:49.512264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:49.512815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:49.513238 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:49.513918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:49.514359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:49.514770 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:49.665674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:49.673913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-18a8dfb8-6922-4b13-ad95-808a3cadc474 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1754 microversion: 2.1 time: 0.182850 Sep 01 18:19:49.674611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 520/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:49 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:50.695183 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:50.695871 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:50.702452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:50.702925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:50.703376 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:50.704050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:50.704522 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:50.704940 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:50.897056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:50.905292 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-29cc1a45-bcf0-4e5b-810b-a9488d17c082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.214421 Sep 01 18:19:50.905862 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 537/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:50 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:51.928028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:51.928658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:51.934581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:51.935128 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:51.935477 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:51.936149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:51.936615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:51.937024 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:52.078823 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:52.086994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-69d522fd-fab3-4034-b592-e64f9ef027a1 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.163481 Sep 01 18:19:52.087554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 521/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:51 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:53.106898 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:53.107532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:53.113972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:53.114511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:53.114941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:53.115618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:53.116064 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:53.116511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:53.253615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:53.262625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-91ff8ec2-f51e-4859-9fb2-c50f97685131 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.159546 Sep 01 18:19:53.263372 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 538/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:53 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:54.284291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:54.284922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:54.292481 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:54.292970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:54.293465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:54.294677 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:54.295138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:54.299657 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:54.439407 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:54.447775 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-89b3ec2d-bcb0-4d5d-a779-c891976dd4f3 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.167302 Sep 01 18:19:54.448357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 522/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:54 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:55.468254 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:55.468892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:55.475350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:55.475830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:55.476258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:55.476994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:55.477439 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:55.477921 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:55.621250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:55.629424 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3fa402a4-4085-4f8f-b5ed-09dd2677bc19 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.165085 Sep 01 18:19:55.630001 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 539/1061] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:55 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:56.651299 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:56.651907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:56.658329 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:56.658799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:56.659228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:56.659903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:56.660369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:56.660791 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:56.807228 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:56.815384 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-36ab66e0-1b41-4167-9a04-b7d7acb0f3b4 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.167985 Sep 01 18:19:56.815946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 523/1062] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:56 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:57.838953 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:57.839491 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:57.846613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:57.846613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:57.846973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:57.847659 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:57.848096 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:57.848552 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:57.987488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:57.995828 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c2bea060-60c6-4756-9a3a-a307e73adc01 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.160784 Sep 01 18:19:57.996401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 540/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:57 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:19:59.016699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:59.017281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:59.023722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:59.024195 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:59.024656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:59.025371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:59.025819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:59.026240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:59.138879 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:19:59.144907 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:19:59.149100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:59.149586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:59.150016 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:59.150707 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:19:59.151149 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:19:59.151566 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:19:59.168808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:19:59.176286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ee0641c5-9c9b-4c27-98cc-1d8997c885b8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/ips" status: 200 len: 145 microversion: 2.1 time: 0.041243 Sep 01 18:19:59.177458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 541/1064] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:19:59 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:19:59.177930 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-7c097b35-d8a2-448a-9e3d-d4de36d7513f tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.164246 Sep 01 18:19:59.178594 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 524/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:19:59 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:00.198457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:00.199066 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:00.205564 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:00.206051 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:00.206483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:00.207165 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:00.207614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:00.208129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:00.358388 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:00.367090 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-773a98e3-5d28-4d7c-a566-3b7112bf9a8d tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1759 microversion: 2.1 time: 0.172607 Sep 01 18:20:00.367652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 542/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:00 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:00.819474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32caed8f-83ed-4786-92be-095f3810d266"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:20:00.821854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:00.828278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:00.828783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:00.829212 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:00.829887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:00.830331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:00.830744 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:01.389011 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:01.396666 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:01.396804 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:01.397252 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:01.397690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:01.398405 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:01.398858 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:01.399283 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:01.543843 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:01.553497 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-06428a2d-bf01-4faa-b5fd-fbb71cf857b6 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1762 microversion: 2.1 time: 0.168231 Sep 01 18:20:01.554069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 543/1067] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:01 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1762 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:20:01.724183 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f06c22bf-8721-43d9-9a87-855124928cc2 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908590 Sep 01 18:20:01.724740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 525/1068] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:20:00 2022] POST /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:09.238634 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:09.243170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:09.248184 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:09.248704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:09.249253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:09.249945 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:09.250398 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:09.250825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:09.281527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-aacf53cb-dec9-4391-8687-5f82966f1ef1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Sep 01 18:20:09.282072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 544/1069] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:20:09 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:09.294066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:09.294615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:09.300760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:09.302176 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:09.302403 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:09.304000 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:09.304489 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:09.304909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:09.334305 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b76c4933-5b72-4850-986d-20ec6de78bb6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/32caed8f-83ed-4786-92be-095f3810d266" status: 200 len: 194 microversion: 2.1 time: 0.045223 Sep 01 18:20:09.334808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 526/1070] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 1 18:20:09 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/32caed8f-83ed-4786-92be-095f3810d266 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:11.033403 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c239f6c4-f50d-4e5e-9f2a-bdc427f7a2d9"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:20:11.040284 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:11.043100 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:11.043586 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:11.044023 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:11.044745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:11.045195 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:11.045615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:11.839785 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-78eb44f1-417b-4aca-88a6-35f7237e0650 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "POST /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810173 Sep 01 18:20:11.840395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 545/1071] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:20:11 2022] POST /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:19.356675 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:19.359019 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:19.361734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=14 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:19.362385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:19.367804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:19.368279 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:19.368734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:19.369411 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:19.369853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:19.370360 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:19.400201 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6d491f28-0818-42ac-9b4d-9e20c9009f6f tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047555 Sep 01 18:20:19.400781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 527/1072] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:20:19 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:20:19.541970 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:19.542568 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:19.544516 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=21 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:19.549534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:19.550017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:19.550448 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:19.551133 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:19.552009 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:19.552205 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:19.555830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:19.580254 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9636106d-3ed8-46a9-b5ae-810d912832bd tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/32caed8f-83ed-4786-92be-095f3810d266" status: 200 len: 194 microversion: 2.1 time: 0.043804 Sep 01 18:20:19.580790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 546/1073] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 1 18:20:19 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/32caed8f-83ed-4786-92be-095f3810d266 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:19.592132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:19.597302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:19.599921 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:19.600419 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:19.600845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:19.601522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:19.601969 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:19.602385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:19.681828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lazy-loading 'services' on Instance uuid f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:20:19.925294 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-57af76b2-8014-44bd-ae4b-2d6716608dc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/32caed8f-83ed-4786-92be-095f3810d266" status: 202 len: 0 microversion: 2.1 time: 0.337335 Sep 01 18:20:19.925898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 528/1074] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:20:19 2022] DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/32caed8f-83ed-4786-92be-095f3810d266 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:20:22.095516 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:22.096017 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:22.103379 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:22.103864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:22.104299 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:22.105011 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:22.105500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:22.105929 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:22.135181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d0747ab6-7bab-4b39-aee2-c1e2ebf920a1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/c239f6c4-f50d-4e5e-9f2a-bdc427f7a2d9" status: 200 len: 194 microversion: 2.1 time: 0.043916 Sep 01 18:20:22.135754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 547/1075] 10.222.0.15 () {58 vars in 1413 bytes} [Thu Sep 1 18:20:22 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/c239f6c4-f50d-4e5e-9f2a-bdc427f7a2d9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:22.147269 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:22.147847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:22.153874 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:22.154343 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:22.154767 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:22.155438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:22.155884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:22.156295 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:22.236367 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lazy-loading 'services' on Instance uuid f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:20:22.485583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3d7999f3-d965-47d9-b263-1d65abee3b62 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/c239f6c4-f50d-4e5e-9f2a-bdc427f7a2d9" status: 202 len: 0 microversion: 2.1 time: 0.342960 Sep 01 18:20:22.486229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 529/1076] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:20:22 2022] DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments/c239f6c4-f50d-4e5e-9f2a-bdc427f7a2d9 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:20:23.654401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:23.656726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:23.664581 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:23.665321 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:23.665755 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:23.666523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:23.666977 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:23.667402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:23.697050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3f5da946-bba5-4d35-b0c0-4f4ab3cdef6c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046486 Sep 01 18:20:23.697601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 548/1077] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:20:23 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:20:23.817001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:23.819285 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:23.825514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:23.826002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:23.826432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:23.827148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:23.827601 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:23.828029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:23.857565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0c0abb3f-0a09-4a21-887d-1114322d1cc9 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045423 Sep 01 18:20:23.858043 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 530/1078] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:20:23 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:20:23.919476 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:23.919972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:23.926294 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:23.926773 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:23.927760 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:23.928601 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:23.929050 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:23.929475 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:23.954354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:20:24.257704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-502b7b5e-a16e-4df1-abdf-480261f8090b tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 204 len: 0 microversion: 2.1 time: 0.341944 Sep 01 18:20:24.258292 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 549/1079] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:20:23 2022] DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:20:24.266515 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:24.267115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:24.274696 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:24.275178 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:24.275609 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:24.276296 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:24.276803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:24.277222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:24.408236 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:24.421352 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c0b736bc-9bb5-4021-998a-6e2b06f1ddf6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1674 microversion: 2.1 time: 0.158622 Sep 01 18:20:24.422124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 531/1080] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:24 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:25.443461 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:25.444185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:25.450613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:25.451087 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:25.451519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:25.452207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:25.452729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:25.453159 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:25.579598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:25.589112 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7ad510d0-1fc5-4659-8354-abbf814da6f6 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1674 microversion: 2.1 time: 0.149805 Sep 01 18:20:25.589675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 550/1081] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:25 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:26.610906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:26.611517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:26.618544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:26.619027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:26.619461 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:26.620154 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:26.620657 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:26.621080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:26.833614 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:26.841225 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f5cccb2f-f11a-4b03-a7ea-8ae0bb0d33f1 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1674 microversion: 2.1 time: 0.234166 Sep 01 18:20:26.841795 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 532/1082] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:26 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:27.582506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-43201ffe-1f3a-41e6-b835-1841b213400a req-9ce24afd-a959-4617-aa88-42babd7f44e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94cd81f-a7cd-448c-88f4-f3a5c335ecc7", "name": "network-vif-deleted", "tag": "c64f2d09-215c-4500-9f06-abf7769366e6"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:20:27.592041 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-43201ffe-1f3a-41e6-b835-1841b213400a req-9ce24afd-a959-4617-aa88-42babd7f44e6 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:27.592558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-43201ffe-1f3a-41e6-b835-1841b213400a req-9ce24afd-a959-4617-aa88-42babd7f44e6 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:27.592986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-43201ffe-1f3a-41e6-b835-1841b213400a req-9ce24afd-a959-4617-aa88-42babd7f44e6 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:27.604781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-43201ffe-1f3a-41e6-b835-1841b213400a req-9ce24afd-a959-4617-aa88-42babd7f44e6 service nova] Creating event network-vif-deleted:c64f2d09-215c-4500-9f06-abf7769366e6 for instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 on hv-cinder-74915 Sep 01 18:20:27.609539 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-43201ffe-1f3a-41e6-b835-1841b213400a req-9ce24afd-a959-4617-aa88-42babd7f44e6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089194 Sep 01 18:20:27.610428 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 551/1083] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:27.864641 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:27.864641 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:27.870022 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:27.870538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:27.871052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:27.871673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:27.872124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:27.872568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:27.907394 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:27.907875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:27.908336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:27.908859 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lazy-loading 'fault' on Instance uuid f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:20:27.949565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f747a57b1a604347b9d2828bdddfa0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c789d40f8a84058a49533d382fe5303', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:27.957273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dccf8727-0074-4131-ad78-e3b89f42d3d8 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 200 len: 1328 microversion: 2.1 time: 0.098974 Sep 01 18:20:27.958350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 533/1084] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:27 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:28.979683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:28.980408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:28.986571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:28.987062 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:28.987496 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:28.988213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:28.988694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:28.989125 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:29.002207 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] HTTP exception thrown: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Request method failure captured: Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 HTTP/1.1 Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPYUDVXrRIxVbEbbZmNvFFcgOO3rWSzUccFG4G_d-MYowLeC9-YhqI3T8OMjv-n-V-J9E3XOdkWEBC4qWep3jKBpXo21O3nLCJ4cnTesyXiaqVQR8uF6sVvy2dyGKgPCbjAZxP7hziMmr5Y_FJdSyZ-qYLAS5u_1lP54Ea0crlx86_U Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:20:29.003808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1c789d40f8a84058a49533d382fe5303", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: f747a57b1a604347b9d2828bdddfa0e9 Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:29.006170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'f94cd81f-a7cd-448c-88f4-f3a5c335ecc7'} Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:20:29.007187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:29.008845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:29.010431 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Returning 404 to user: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:20:29.010431 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-36ea16f8-0ea0-432a-a402-65b06cab753c tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 404 len: 111 microversion: 2.1 time: 0.030678 Sep 01 18:20:29.010431 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 552/1085] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:28 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 18:20:29.014729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a6df6458-7810-4a94-ba73-d9801931c7fe tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '.version_select at 0x7f446ab1ca60>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:29.134004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a6df6458-7810-4a94-ba73-d9801931c7fe tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981148502" status: 202 len: 0 microversion: 2.1 time: 0.122936 Sep 01 18:20:29.134589 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 534/1086] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 1 18:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981148502 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:20:32.585332 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:32.585815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:32.592275 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:32.592785 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:32.593218 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:32.593895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:32.594346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:32.594765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:32.608844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] HTTP exception thrown: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Request method failure captured: Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 HTTP/1.1 Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPYUDVXrRIxVbEbbZmNvFFcgOO3rWSzUccFG4G_d-MYowLeC9-YhqI3T8OMjv-n-V-J9E3XOdkWEBC4qWep3jKBpXo21O3nLCJ4cnTesyXiaqVQR8uF6sVvy2dyGKgPCbjAZxP7hziMmr5Y_FJdSyZ-qYLAS5u_1lP54Ea0crlx86_U Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:20:32.610370 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1c789d40f8a84058a49533d382fe5303", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: f747a57b1a604347b9d2828bdddfa0e9 Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.611988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'f94cd81f-a7cd-448c-88f4-f3a5c335ecc7'} Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:20:32.613101 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.614617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.616971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Returning 404 to user: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:20:32.616971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a607a547-e368-4bb3-92c8-660b1e266a95 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 404 len: 111 microversion: 2.1 time: 0.030328 Sep 01 18:20:32.616971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 553/1087] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:20:32 2022] DELETE /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:20:32.620529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:32.621138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: f94cd81f-a7cd-448c-88f4-f3a5c335ecc7] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:32.628212 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:32.628722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:32.629153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:32.629834 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:32.630281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:32.630700 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:32.643600 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] HTTP exception thrown: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Request method failure captured: Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 HTTP/1.1 Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPYUDVXrRIxVbEbbZmNvFFcgOO3rWSzUccFG4G_d-MYowLeC9-YhqI3T8OMjv-n-V-J9E3XOdkWEBC4qWep3jKBpXo21O3nLCJ4cnTesyXiaqVQR8uF6sVvy2dyGKgPCbjAZxP7hziMmr5Y_FJdSyZ-qYLAS5u_1lP54Ea0crlx86_U Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:20:32.645246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1c789d40f8a84058a49533d382fe5303", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: f747a57b1a604347b9d2828bdddfa0e9 Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.646911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'f94cd81f-a7cd-448c-88f4-f3a5c335ecc7'} Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:20:32.647982 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. Sep 01 18:20:32.649513 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:32.650889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Returning 404 to user: Instance f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:20:32.650889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1c71ae7b-0d52-4fd8-bf6e-a8cf424668de tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7" status: 404 len: 111 microversion: 2.1 time: 0.030404 Sep 01 18:20:32.650889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 535/1088] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:32 2022] GET /compute/v2.1/servers/f94cd81f-a7cd-448c-88f4-f3a5c335ecc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:20:33.935906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:33.936446 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:33.942812 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:33.943293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:33.944413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:33.945199 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:33.945652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:33.946076 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:33.959311 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] HTTP exception thrown: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Request method failure captured: Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 HTTP/1.1 Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPYUDVXrRIxVbEbbZmNvFFcgOO3rWSzUccFG4G_d-MYowLeC9-YhqI3T8OMjv-n-V-J9E3XOdkWEBC4qWep3jKBpXo21O3nLCJ4cnTesyXiaqVQR8uF6sVvy2dyGKgPCbjAZxP7hziMmr5Y_FJdSyZ-qYLAS5u_1lP54Ea0crlx86_U Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:20:33.960866 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1c789d40f8a84058a49533d382fe5303", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: f747a57b1a604347b9d2828bdddfa0e9 Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.962481 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '5cce0d3b-3280-47a3-a0f1-f42481c397c1'} Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:20:33.963319 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.964625 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.965888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Returning 404 to user: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:20:33.965888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c56def5d-c242-4691-9af8-5058babae364 tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 404 len: 111 microversion: 2.1 time: 0.030190 Sep 01 18:20:33.965888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 554/1089] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:20:33 2022] DELETE /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:20:33.970371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:33.970983 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] [instance: 5cce0d3b-3280-47a3-a0f1-f42481c397c1] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:33.977181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:33.977661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:33.978096 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:33.978782 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:33.979237 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:33.979662 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:33.993298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] HTTP exception thrown: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Request method failure captured: Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 HTTP/1.1 Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPYUDVXrRIxVbEbbZmNvFFcgOO3rWSzUccFG4G_d-MYowLeC9-YhqI3T8OMjv-n-V-J9E3XOdkWEBC4qWep3jKBpXo21O3nLCJ4cnTesyXiaqVQR8uF6sVvy2dyGKgPCbjAZxP7hziMmr5Y_FJdSyZ-qYLAS5u_1lP54Ea0crlx86_U Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:20:33.994897 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_1c789d40f8a84058a49533d382fe5303", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/1c789d40f8a84058a49533d382fe5303"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: 1c789d40f8a84058a49533d382fe5303 Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeTestJSON-582086451 Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: f747a57b1a604347b9d2828bdddfa0e9 Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeTestJSON-582086451-project Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.996585 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '5cce0d3b-3280-47a3-a0f1-f42481c397c1'} Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:20:33.997574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. Sep 01 18:20:33.998841 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:20:34.000081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] Returning 404 to user: Instance 5cce0d3b-3280-47a3-a0f1-f42481c397c1 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:20:34.000081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-83639740-479c-47ac-b844-c1daca86501e tempest-AttachVolumeTestJSON-582086451 tempest-AttachVolumeTestJSON-582086451-project] 10.222.0.15 "GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1" status: 404 len: 111 microversion: 2.1 time: 0.029616 Sep 01 18:20:34.000081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 536/1090] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:33 2022] GET /compute/v2.1/servers/5cce0d3b-3280-47a3-a0f1-f42481c397c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:20:45.089728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:45.090467 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:45.224055 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1eea955e-6c7a-48b5-a7f3-14c9425ce12c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: .version_select at 0x7f446a73adc0>, body: {"keypair": {"name": "tempest-keypair-1163117556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNEoN+d5DpSEsmUwEALZasnmfnf23t2cY/p6XKvW5dL+vNxensndEsdUwrlgd1V8QWNkL+U2Vdoqq4LhGcX+YY9LEi4TeziFpUlSept/rovL+GuFw0qV9Y3IW7UDkCSTg=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:20:45.241962 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-1eea955e-6c7a-48b5-a7f3-14c9425ce12c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:20:45.246808 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-1eea955e-6c7a-48b5-a7f3-14c9425ce12c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:20:45.368211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1eea955e-6c7a-48b5-a7f3-14c9425ce12c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283955 Sep 01 18:20:45.374895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 555/1091] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:20:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:48.221713 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1741511388", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c"}], "security_groups": [{"name": "tempest-securitygroup--227547555"}], "key_name": "tempest-keypair-1163117556", "user_data": "}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:20:48.231207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:48.231870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:48.337486 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] validate_networks() for [('11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:20:48.718220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:20:48.718636 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:20:48.719103 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:20:48.719505 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:20:48.719911 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:20:48.729573 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:48.730050 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:48.730474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:48.731187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:48.731633 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:48.732049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:48.748446 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:20:48.752424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:20:48.763414 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:20:48.765720 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:20:48.913849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8a5ea77c-1b4e-4806-aa15-a3dab59e1aec tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.695323 Sep 01 18:20:48.914990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 537/1092] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:20:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:20:48.932067 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-33cc1e87-4784-420b-a886-9389b8737461 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:48.932722 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-33cc1e87-4784-420b-a886-9389b8737461 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:48.993137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-33cc1e87-4784-420b-a886-9389b8737461 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:49.000039 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-33cc1e87-4784-420b-a886-9389b8737461 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1242 microversion: 2.1 time: 0.075868 Sep 01 18:20:49.000848 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 556/1093] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:48 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:50.022981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-559fcb13-98a0-4320-b838-b92420e9bb27 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:50.023598 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-559fcb13-98a0-4320-b838-b92420e9bb27 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:50.078385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-559fcb13-98a0-4320-b838-b92420e9bb27 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:50.085977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-559fcb13-98a0-4320-b838-b92420e9bb27 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1242 microversion: 2.1 time: 0.067959 Sep 01 18:20:50.086539 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 538/1094] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:50 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:51.106673 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:51.107320 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:51.113890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:51.114473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:51.114801 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:51.115499 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:51.116493 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:51.117086 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:51.180738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:51.188836 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-50432dc2-8f25-4416-932b-7750d7739a5c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1294 microversion: 2.1 time: 0.086011 Sep 01 18:20:51.189977 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 557/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:51 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:52.211591 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:52.212277 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:52.219395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:52.220168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:52.220734 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:52.221525 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:52.222061 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:52.222549 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:52.391462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:52.400579 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-149cf3b3-34a9-42b8-a6d6-7aea92203be9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.193440 Sep 01 18:20:52.401465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 539/1096] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:52 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:53.085395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-9145e914-22f0-4272-b20b-bf0cf364c9e4 req-5dfc65ed-0f8e-4ae1-b154-678fb4238a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ac1649-e139-4b5e-b08b-ea027725e50d", "tag": "9b228f76-04df-412d-87e7-960151bda1f2"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:20:53.095405 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9145e914-22f0-4272-b20b-bf0cf364c9e4 req-5dfc65ed-0f8e-4ae1-b154-678fb4238a41 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:53.096072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9145e914-22f0-4272-b20b-bf0cf364c9e4 req-5dfc65ed-0f8e-4ae1-b154-678fb4238a41 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:53.096535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-9145e914-22f0-4272-b20b-bf0cf364c9e4 req-5dfc65ed-0f8e-4ae1-b154-678fb4238a41 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:53.107570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-9145e914-22f0-4272-b20b-bf0cf364c9e4 req-5dfc65ed-0f8e-4ae1-b154-678fb4238a41 service nova] Creating event network-changed:9b228f76-04df-412d-87e7-960151bda1f2 for instance c4ac1649-e139-4b5e-b08b-ea027725e50d on hv-cinder-74915 Sep 01 18:20:53.112564 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-9145e914-22f0-4272-b20b-bf0cf364c9e4 req-5dfc65ed-0f8e-4ae1-b154-678fb4238a41 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031383 Sep 01 18:20:53.113238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 558/1097] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:20:53.422903 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:53.423599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:53.430593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:53.431421 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:53.431602 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:53.432423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:53.432872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:53.433291 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:53.655213 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:53.664081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2bfc96f4-e2fc-41a7-9a91-52db883e3b62 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.244850 Sep 01 18:20:53.664762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 540/1098] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:53 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:54.689908 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:54.690602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:54.696951 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:54.697426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:54.697851 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:54.698534 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:54.698977 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:54.699395 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:54.828243 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:54.836804 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7f9a7aca-6975-4ce4-a95c-45089c1f9254 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.154902 Sep 01 18:20:54.837377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 559/1099] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:54 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:55.858101 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:55.858621 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:55.865110 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:55.865593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:55.866029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:55.867287 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:55.867743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:55.868169 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:55.995957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:56.003558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e74fabad-48ec-4969-9469-97ebb80004e2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.149437 Sep 01 18:20:56.004123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 541/1100] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:55 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:57.024099 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:57.024729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:57.032292 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:57.032789 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:57.033215 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:57.033902 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:57.034347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:57.034764 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:57.164425 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:57.172203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-96ee0403-37fb-449b-9241-9cd0e2ba7c9c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.152962 Sep 01 18:20:57.172791 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 560/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:57 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:58.193230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:58.193760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:58.200608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:58.201080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:58.201505 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:58.202177 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:58.202620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:58.203033 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:58.329929 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:58.338150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-88552d36-7993-4e7f-8370-bf697f2c9b4d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.148866 Sep 01 18:20:58.338714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 542/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:58 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:59.359339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:20:59.359884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:20:59.362020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:59.366882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:59.367358 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:59.367790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:59.368517 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:59.368968 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:59.369389 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:59.497654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:20:59.505216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e37bdc46-cf1a-4566-bf23-f0e5e8367d80 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.149850 Sep 01 18:20:59.505807 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 561/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:20:59 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:20:59.825434 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-cd8aaab6-aac4-4284-b736-ebee772991f0 req-65658e63-3cac-470c-b831-0acf03c025ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ac1649-e139-4b5e-b08b-ea027725e50d", "name": "network-vif-plugged", "status": "completed", "tag": "9b228f76-04df-412d-87e7-960151bda1f2"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:20:59.832083 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:20:59.837875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cd8aaab6-aac4-4284-b736-ebee772991f0 req-65658e63-3cac-470c-b831-0acf03c025ab service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:20:59.838352 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cd8aaab6-aac4-4284-b736-ebee772991f0 req-65658e63-3cac-470c-b831-0acf03c025ab service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:20:59.838803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cd8aaab6-aac4-4284-b736-ebee772991f0 req-65658e63-3cac-470c-b831-0acf03c025ab service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:20:59.850819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-cd8aaab6-aac4-4284-b736-ebee772991f0 req-65658e63-3cac-470c-b831-0acf03c025ab service nova] Creating event network-vif-plugged:9b228f76-04df-412d-87e7-960151bda1f2 for instance c4ac1649-e139-4b5e-b08b-ea027725e50d on hv-cinder-74915 Sep 01 18:20:59.856097 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-cd8aaab6-aac4-4284-b736-ebee772991f0 req-65658e63-3cac-470c-b831-0acf03c025ab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034188 Sep 01 18:20:59.857081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 543/1104] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:00.525749 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:00.526354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:00.532778 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:00.533234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:00.533665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:00.534354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:00.534805 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:00.535229 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:00.670768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:21:00.678415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-733f70eb-ac89-42f5-94bd-88cca1c83fca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.156580 Sep 01 18:21:00.678980 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 562/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:00 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:21:01.701310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:01.702004 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:01.703872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=8 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:21:01.709546 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:01.710023 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:01.710552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:01.711267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:01.711708 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:01.712127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:01.844108 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:21:01.852482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-04ac344e-6a49-41b4-adf0-0b6075c79d85 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1367 microversion: 2.1 time: 0.155579 Sep 01 18:21:01.853063 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 544/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:01 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:21:02.873836 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:02.874531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:02.880925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:02.881402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:02.881829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:02.883257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:02.883702 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:02.884124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:03.011132 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:21:03.018772 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a6db5a5f-4a5d-4326-9853-800dda680421 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1558 microversion: 2.1 time: 0.148868 Sep 01 18:21:03.019324 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 563/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:02 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:21:03.038705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:03.039281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:03.045865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:03.046337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:03.046762 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:03.047435 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:03.047875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:03.048296 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:03.124086 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d28de417-ccac-458e-bc14-67104e1f45d1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089136 Sep 01 18:21:03.124656 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 545/1108] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:21:03 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:04.335590 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-90d50f09-3b6f-495e-8ab1-126840981076 req-af95b58e-86d6-4615-a72c-b4d4f7e9710b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4ac1649-e139-4b5e-b08b-ea027725e50d", "tag": "9b228f76-04df-412d-87e7-960151bda1f2"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:21:04.345478 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-90d50f09-3b6f-495e-8ab1-126840981076 req-af95b58e-86d6-4615-a72c-b4d4f7e9710b service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:04.345956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-90d50f09-3b6f-495e-8ab1-126840981076 req-af95b58e-86d6-4615-a72c-b4d4f7e9710b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:04.346404 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-90d50f09-3b6f-495e-8ab1-126840981076 req-af95b58e-86d6-4615-a72c-b4d4f7e9710b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:04.359293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-90d50f09-3b6f-495e-8ab1-126840981076 req-af95b58e-86d6-4615-a72c-b4d4f7e9710b service nova] Creating event network-changed:9b228f76-04df-412d-87e7-960151bda1f2 for instance c4ac1649-e139-4b5e-b08b-ea027725e50d on hv-cinder-74915 Sep 01 18:21:04.364336 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-90d50f09-3b6f-495e-8ab1-126840981076 req-af95b58e-86d6-4615-a72c-b4d4f7e9710b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032440 Sep 01 18:21:04.365024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 564/1109] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:05.152976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1312213951"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:21:05.153538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:05.159987 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:05.160541 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:05.160975 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:05.161674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:05.162124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:05.162572 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:05.298007 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.network.security_group_api [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Removing security group 5736e67a-1ceb-475f-a442-422cbd8d2c73 from port 02aad05c-d44e-461e-87bc-9b9f57c7ae11 Sep 01 18:21:05.691634 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0b04af9a-1c21-4b29-a1ae-8dde00f81a03 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/action" status: 202 len: 0 microversion: 2.1 time: 0.543209 Sep 01 18:21:05.692246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 546/1110] 10.222.0.15 () {60 vars in 1278 bytes} [Thu Sep 1 18:21:05 2022] POST /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:21:06.379819 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-f080f021-936d-424b-a13f-3e57c75ff71c req-e44366b2-f7da-4a3a-89c9-dec455eece25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad556ce-b187-4bec-a1ee-88445047c88e", "tag": "02aad05c-d44e-461e-87bc-9b9f57c7ae11"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:21:06.389817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-f080f021-936d-424b-a13f-3e57c75ff71c req-e44366b2-f7da-4a3a-89c9-dec455eece25 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:06.390301 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-f080f021-936d-424b-a13f-3e57c75ff71c req-e44366b2-f7da-4a3a-89c9-dec455eece25 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:06.390726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-f080f021-936d-424b-a13f-3e57c75ff71c req-e44366b2-f7da-4a3a-89c9-dec455eece25 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:06.402464 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-f080f021-936d-424b-a13f-3e57c75ff71c req-e44366b2-f7da-4a3a-89c9-dec455eece25 service nova] Creating event network-changed:02aad05c-d44e-461e-87bc-9b9f57c7ae11 for instance aad556ce-b187-4bec-a1ee-88445047c88e on hv-cinder-74915 Sep 01 18:21:06.407502 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-f080f021-936d-424b-a13f-3e57c75ff71c req-e44366b2-f7da-4a3a-89c9-dec455eece25 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032129 Sep 01 18:21:06.408120 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 565/1111] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:07.154326 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:07.155257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:07.161325 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:07.162009 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:07.162448 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:07.163185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:07.163888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:07.164344 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:07.256094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lazy-loading 'services' on Instance uuid aad556ce-b187-4bec-a1ee-88445047c88e {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:21:07.525312 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bdda7c20-af1d-49df-88b5-e5cc39634a49 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments/7c179053-9b9a-4b11-a093-f930a6a83a92" status: 202 len: 0 microversion: 2.1 time: 0.375350 Sep 01 18:21:07.525942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 547/1112] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:21:07 2022] DELETE /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments/7c179053-9b9a-4b11-a093-f930a6a83a92 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:21:07.536176 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:07.539817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:07.546354 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:07.546839 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:07.547505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:07.548208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:07.548690 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:07.549119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:07.580955 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a95f6f57-26d4-49ff-a514-f9e6788bcbac tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049826 Sep 01 18:21:07.581735 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 566/1113] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:21:07 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:08.431220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-d22e4910-beeb-470d-8e48-36e957ef392b req-af1c5bc5-e3b4-4f2f-88ae-42e33dc7aa8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad556ce-b187-4bec-a1ee-88445047c88e", "tag": "02aad05c-d44e-461e-87bc-9b9f57c7ae11"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:21:08.440598 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-d22e4910-beeb-470d-8e48-36e957ef392b req-af1c5bc5-e3b4-4f2f-88ae-42e33dc7aa8b service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:08.441071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-d22e4910-beeb-470d-8e48-36e957ef392b req-af1c5bc5-e3b4-4f2f-88ae-42e33dc7aa8b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:08.441496 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-d22e4910-beeb-470d-8e48-36e957ef392b req-af1c5bc5-e3b4-4f2f-88ae-42e33dc7aa8b service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:08.452840 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-d22e4910-beeb-470d-8e48-36e957ef392b req-af1c5bc5-e3b4-4f2f-88ae-42e33dc7aa8b service nova] Creating event network-changed:02aad05c-d44e-461e-87bc-9b9f57c7ae11 for instance aad556ce-b187-4bec-a1ee-88445047c88e on hv-cinder-74915 Sep 01 18:21:08.457647 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-d22e4910-beeb-470d-8e48-36e957ef392b req-af1c5bc5-e3b4-4f2f-88ae-42e33dc7aa8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031724 Sep 01 18:21:08.458771 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 548/1114] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:08.593185 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:08.595309 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:08.602645 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:08.603119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:08.603550 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:08.604260 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:08.604721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:08.605143 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:08.634840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cdd34b64-9f4d-46e1-9e83-4a6b01c5be52 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Sep 01 18:21:08.635595 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 567/1115] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:21:08 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:09.648338 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:09.650529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:09.656681 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:09.657148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:09.657568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:09.658240 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:09.658681 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:09.659094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:09.687098 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-f3de1773-7ad3-4872-91c2-c771e9c458e9 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044119 Sep 01 18:21:09.687635 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 549/1116] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:21:09 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:21:09.698602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:09.699119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:09.705531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:09.706035 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:09.706469 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:09.707162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:09.707612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:09.708033 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:09.784012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] HTTP exception thrown: Instance aad556ce-b187-4bec-a1ee-88445047c88e is not attached to volume 7c179053-9b9a-4b11-a093-f930a6a83a92 Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Request method failure captured: Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments/7c179053-9b9a-4b11-a093-f930a6a83a92 HTTP/1.1 Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPdIWA41dfutXsiKyd0Ut61BUPfjl4RJLhsKJ85EmF2tDwW18vuvNJan0K6zg3H_1A9inG99BQ1wUDoFzk3EbFnOZnHx0os2o5h3bgwvQZvmM93S_bsyp95kbwxiq1SNmSl6RgSzlTm4v0rYL5ZM7DqgKyOVZgI0kdLxQdW4p3SkJhQ Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: a2d986195f844099b8616c92bc2162b4 Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-TestMinimumBasicScenario-1763377092 Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:21:09.786411 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a2d986195f844099b8616c92bc2162b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a2d986195f844099b8616c92bc2162b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a2d986195f844099b8616c92bc2162b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a2d986195f844099b8616c92bc2162b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-TestMinimumBasicScenario-1763377092 Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: a2d986195f844099b8616c92bc2162b4 Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1763377092 Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-TestMinimumBasicScenario-1763377092-project Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 9d20630980d642fa90636ff4c2d67075 Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-TestMinimumBasicScenario-1763377092-project Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:21:09.788239 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance aad556ce-b187-4bec-a1ee-88445047c88e is not attached to volume 7c179053-9b9a-4b11-a093-f930a6a83a92 Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'server_id': 'aad556ce-b187-4bec-a1ee-88445047c88e', 'id': '7c179053-9b9a-4b11-a093-f930a6a83a92'} Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7c179053-9b9a-4b11-a093-f930a6a83a92. Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:21:09.789230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad556ce-b187-4bec-a1ee-88445047c88e is not attached to volume 7c179053-9b9a-4b11-a093-f930a6a83a92 Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad556ce-b187-4bec-a1ee-88445047c88e is not attached to volume 7c179053-9b9a-4b11-a093-f930a6a83a92 Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:21:09.790933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Returning 404 to user: Instance aad556ce-b187-4bec-a1ee-88445047c88e is not attached to volume 7c179053-9b9a-4b11-a093-f930a6a83a92 {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:21:09.792963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-cc0d0b44-1a74-4561-afbd-000b10edfe15 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments/7c179053-9b9a-4b11-a093-f930a6a83a92" status: 404 len: 154 microversion: 2.1 time: 0.093940 Sep 01 18:21:09.792963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 568/1117] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:21:09 2022] DELETE /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e/os-volume_attachments/7c179053-9b9a-4b11-a093-f930a6a83a92 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:21:11.061800 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:11.062298 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:11.068593 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:11.069068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:11.069589 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:11.070283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:11.070723 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:11.071139 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:11.094663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:21:11.411028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3195657d-e483-42f2-86ef-bf37a7968f7b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 204 len: 0 microversion: 2.1 time: 0.352738 Sep 01 18:21:11.411717 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 550/1118] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:21:11 2022] DELETE /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:21:11.420686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:11.421289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:11.428191 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:11.428694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:11.429121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:11.429826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:11.430273 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:11.430685 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:11.561072 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:21:11.568811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1425cbc2-cdaf-4043-98c6-49a3fc5809db tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1556 microversion: 2.1 time: 0.151898 Sep 01 18:21:11.569931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 569/1119] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:11 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:21:12.590870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:12.591473 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:12.598140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:12.598611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:12.599037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:12.599715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:12.600155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:12.601306 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:12.739124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:21:12.744836 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e583b3ca-dbcc-408a-a249-5433a0db3a96 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1556 microversion: 2.1 time: 0.158410 Sep 01 18:21:12.745400 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 551/1120] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:12 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 18:21:13.765543 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:13.766165 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:13.772567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:13.773056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:13.773498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:13.774198 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:13.774652 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:13.775080 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:13.908825 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:21:13.917721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8c3f7f96-67cd-4af3-8df0-ab5dcc5dc17b tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1556 microversion: 2.1 time: 0.155999 Sep 01 18:21:13.918289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 570/1121] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:13 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:21:14.120988 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-433cfd59-ab81-4f22-a914-fa7a4ebd9577 req-39bc370c-ff31-4437-a409-91f6212d1fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad556ce-b187-4bec-a1ee-88445047c88e", "name": "network-vif-deleted", "tag": "02aad05c-d44e-461e-87bc-9b9f57c7ae11"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:21:14.131482 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-433cfd59-ab81-4f22-a914-fa7a4ebd9577 req-39bc370c-ff31-4437-a409-91f6212d1fc2 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:14.132215 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-433cfd59-ab81-4f22-a914-fa7a4ebd9577 req-39bc370c-ff31-4437-a409-91f6212d1fc2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:14.133258 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-433cfd59-ab81-4f22-a914-fa7a4ebd9577 req-39bc370c-ff31-4437-a409-91f6212d1fc2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:14.144703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-433cfd59-ab81-4f22-a914-fa7a4ebd9577 req-39bc370c-ff31-4437-a409-91f6212d1fc2 service nova] Creating event network-vif-deleted:02aad05c-d44e-461e-87bc-9b9f57c7ae11 for instance aad556ce-b187-4bec-a1ee-88445047c88e on hv-cinder-74915 Sep 01 18:21:14.149655 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-433cfd59-ab81-4f22-a914-fa7a4ebd9577 req-39bc370c-ff31-4437-a409-91f6212d1fc2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Sep 01 18:21:14.150336 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 552/1122] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:21:14.939213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:14.939598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:14.946776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:14.948559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:14.948559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:14.948559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:14.948880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:14.949245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:14.979906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:14.980420 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:14.980860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:14.981312 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lazy-loading 'fault' on Instance uuid aad556ce-b187-4bec-a1ee-88445047c88e {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:21:15.025079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d20630980d642fa90636ff4c2d67075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d986195f844099b8616c92bc2162b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:21:15.033033 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c5f7833b-ea17-43aa-84c6-3141c117dc71 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 200 len: 1349 microversion: 2.1 time: 0.097936 Sep 01 18:21:15.033641 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 571/1123] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:14 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:21:16.055947 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:16.056698 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] [instance: aad556ce-b187-4bec-a1ee-88445047c88e] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:21:16.062739 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:16.063230 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:16.063658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:16.064357 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:21:16.064806 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:21:16.065220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:21:16.077994 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] HTTP exception thrown: Instance aad556ce-b187-4bec-a1ee-88445047c88e could not be found. Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Request method failure captured: Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e HTTP/1.1 Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPdIWA41dfutXsiKyd0Ut61BUPfjl4RJLhsKJ85EmF2tDwW18vuvNJan0K6zg3H_1A9inG99BQ1wUDoFzk3EbFnOZnHx0os2o5h3bgwvQZvmM93S_bsyp95kbwxiq1SNmSl6RgSzlTm4v0rYL5ZM7DqgKyOVZgI0kdLxQdW4p3SkJhQ Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: a2d986195f844099b8616c92bc2162b4 Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-TestMinimumBasicScenario-1763377092 Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:21:16.079557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a2d986195f844099b8616c92bc2162b4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a2d986195f844099b8616c92bc2162b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a2d986195f844099b8616c92bc2162b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a2d986195f844099b8616c92bc2162b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-TestMinimumBasicScenario-1763377092 Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: a2d986195f844099b8616c92bc2162b4 Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1763377092 Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-TestMinimumBasicScenario-1763377092-project Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 9d20630980d642fa90636ff4c2d67075 Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-TestMinimumBasicScenario-1763377092-project Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance aad556ce-b187-4bec-a1ee-88445047c88e could not be found. Sep 01 18:21:16.081322 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'aad556ce-b187-4bec-a1ee-88445047c88e'} Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad556ce-b187-4bec-a1ee-88445047c88e could not be found. Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:21:16.082301 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad556ce-b187-4bec-a1ee-88445047c88e could not be found. Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad556ce-b187-4bec-a1ee-88445047c88e could not be found. Sep 01 18:21:16.083937 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:21:16.085643 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Returning 404 to user: Instance aad556ce-b187-4bec-a1ee-88445047c88e could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:21:16.085643 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-42ae61c3-721e-4f4c-8de0-fed265a4f082 tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e" status: 404 len: 111 microversion: 2.1 time: 0.030226 Sep 01 18:21:16.085643 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 553/1124] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:21:16 2022] GET /compute/v2.1/servers/aad556ce-b187-4bec-a1ee-88445047c88e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:21:16.089758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9fb03df8-fc94-4297-a890-51d9d17db02a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] Calling method '.version_select at 0x7f446a6a4dc0>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:21:16.097859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:21:16.160876 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9fb03df8-fc94-4297-a890-51d9d17db02a tempest-TestMinimumBasicScenario-1763377092 tempest-TestMinimumBasicScenario-1763377092-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2108266222" status: 202 len: 0 microversion: 2.1 time: 0.074888 Sep 01 18:21:16.161475 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 572/1125] 10.222.0.15 () {58 vars in 1272 bytes} [Thu Sep 1 18:21:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2108266222 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:22:19.468776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:19.469909 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:19.475073 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:19.475541 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:19.481687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:19.484115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:19.484115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:19.484115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:19.484115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:19.484591 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:19.507939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2484206c-3724-48a9-9cda-be621867023c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/ips" status: 200 len: 150 microversion: 2.1 time: 0.041055 Sep 01 18:22:19.508526 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 554/1126] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:22:19 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:22:21.712289 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=80 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:21.713262 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:22:21.713401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Thu Sep 1 18:22:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments (ip 10.222.0.15) !!! Sep 01 18:22:21.726255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8f221ae-2c9b-4b8d-934c-1a5610eaf964"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:22:21.729499 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:21.735463 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:21.735941 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:21.736393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:21.737076 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:21.737523 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:21.738559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:22.557372 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-45d3abf1-6a96-403b-be12-e7c98f61303d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848096 Sep 01 18:22:22.557972 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 573/1127] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:22:21 2022] POST /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:22:30.242834 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0326a9e6-29bf-4f5e-8caf-d91dc93f656a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: .version_select at 0x7f446aa70f70>, body: {"keypair": {"name": "tempest-keypair-1458625035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtyGQ5dwU95FoNIkNkFjh+tzN5J4BQfAAznTrxR7YBRNl+47RX1U8Wy9qvuhl4ByrWHZo/HG+VgDQO36JRwq+26LohghOhHbIh+G6JLSkEaVbai60AmEpskdm1Eekd88Q=="}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:22:30.259846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-0326a9e6-29bf-4f5e-8caf-d91dc93f656a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:22:30.263749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-0326a9e6-29bf-4f5e-8caf-d91dc93f656a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:22:30.366080 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0326a9e6-29bf-4f5e-8caf-d91dc93f656a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127593 Sep 01 18:22:30.366679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 555/1128] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:22:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:22:32.564558 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:32.565315 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:32.569882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-452255314", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c"}], "security_groups": [{"name": "tempest-securitygroup--2076221846"}], "key_name": "tempest-keypair-1458625035", "user_data": "}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:22:32.676430 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] validate_networks() for [('11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:22:33.044938 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:22:33.045362 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:22:33.045835 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:22:33.046245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:22:33.046657 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:22:33.056145 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:33.056863 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:33.057300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:33.058030 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:33.058480 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:33.058905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:33.075464 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:22:33.079400 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:22:33.090363 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:22:33.092820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:22:33.217189 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-69ed139e-6bb7-4774-8410-aa83aab7ce90 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.654046 Sep 01 18:22:33.217830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 574/1129] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:22:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:22:33.230564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3707341b-ee69-4673-b439-cc8a51db106f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:33.231302 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3707341b-ee69-4673-b439-cc8a51db106f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:33.288364 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3707341b-ee69-4673-b439-cc8a51db106f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:33.299134 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3707341b-ee69-4673-b439-cc8a51db106f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1241 microversion: 2.1 time: 0.074334 Sep 01 18:22:33.299768 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 556/1130] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:33 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:34.321840 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:34.322497 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:34.329702 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:34.330139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:34.330566 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:34.331254 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:34.331697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:34.332140 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:34.398068 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:34.406925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-50e50aa2-7027-4f5e-8c2a-60491202bba9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1245 microversion: 2.1 time: 0.089953 Sep 01 18:22:34.407330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 575/1131] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:34 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:35.428943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:35.429467 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:35.435714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:35.436187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:35.436654 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:35.437335 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:35.437773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:35.438190 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:35.500028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:35.507970 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2e52a8fd-6b59-4e62-87a4-a7a625ceca9d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1311 microversion: 2.1 time: 0.083029 Sep 01 18:22:35.510279 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 557/1132] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:35 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:36.529830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:36.530440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:36.536956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:36.537476 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:36.537912 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:36.538612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:36.539063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:36.539486 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:36.891293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:36.899161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-79132394-f5c9-441f-8003-12e443204684 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.373235 Sep 01 18:22:36.899870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 576/1133] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:36 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:37.053800 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-9852d5cb-65d0-4b44-8b28-15444d833b93 req-cd3a34cb-f638-4f83-b5df-5c87bbd31489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea61be24-578a-4a3b-b3cc-11707f44787a", "tag": "a4a63791-6342-4651-90f1-c21f1505479d"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:22:37.063629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-9852d5cb-65d0-4b44-8b28-15444d833b93 req-cd3a34cb-f638-4f83-b5df-5c87bbd31489 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:37.064093 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-9852d5cb-65d0-4b44-8b28-15444d833b93 req-cd3a34cb-f638-4f83-b5df-5c87bbd31489 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:37.064544 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-9852d5cb-65d0-4b44-8b28-15444d833b93 req-cd3a34cb-f638-4f83-b5df-5c87bbd31489 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:37.077853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-9852d5cb-65d0-4b44-8b28-15444d833b93 req-cd3a34cb-f638-4f83-b5df-5c87bbd31489 service nova] Creating event network-changed:a4a63791-6342-4651-90f1-c21f1505479d for instance ea61be24-578a-4a3b-b3cc-11707f44787a on hv-cinder-74915 Sep 01 18:22:37.081445 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-9852d5cb-65d0-4b44-8b28-15444d833b93 req-cd3a34cb-f638-4f83-b5df-5c87bbd31489 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031444 Sep 01 18:22:37.082187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 558/1134] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:22:37.921514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:37.922098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:37.928490 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:37.928963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:37.929390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:37.930063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:37.930506 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:37.930922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:38.055850 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:38.063708 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ea291be4-11f1-4e21-9219-f887c1283338 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.147132 Sep 01 18:22:38.064269 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 577/1135] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:37 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:39.085124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:39.085877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:39.092704 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:39.093181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:39.093652 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:39.094384 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:39.094831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:39.095251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:39.223554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:39.231993 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-93aebe90-bc14-441a-95fd-ea8a44bb3d03 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.151266 Sep 01 18:22:39.232870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 559/1136] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:39 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:40.252743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:40.253482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:40.259943 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:40.260494 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:40.261086 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:40.261794 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:40.262251 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:40.262679 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:40.392413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:40.399957 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-91dee57b-9d2c-43a0-aa21-1b3badfc07ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.151206 Sep 01 18:22:40.400569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 578/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:40 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:41.420405 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:41.420998 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:41.427437 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:41.427913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:41.428371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:41.429058 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:41.429538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:41.429959 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:41.567395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:41.575432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-41589580-d5b9-48a9-b37c-2d4ddeabb0a0 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.159281 Sep 01 18:22:41.576001 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 560/1138] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:41 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:42.596378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:42.597006 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:42.603346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:42.604498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:42.605034 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:42.605718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:42.606166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:42.606582 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:42.735931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:42.744193 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8bdad632-5df1-4c1c-8c2c-d601bb5eba06 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.151662 Sep 01 18:22:42.746010 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 579/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:42 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:43.766760 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:43.767365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:43.769853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:43.774568 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:43.775041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:43.776035 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:43.776866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:43.777311 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:43.777727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:43.905861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:43.912261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e515157b-6aa6-43d1-9537-71038e40dcc3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.149357 Sep 01 18:22:43.912843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 561/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:43 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:44.385532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-73a1d33d-5ebe-4464-b80b-0a23a9393d58 req-e47a26c4-d545-4b1c-bff3-55fc7bd929b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea61be24-578a-4a3b-b3cc-11707f44787a", "name": "network-vif-plugged", "status": "completed", "tag": "a4a63791-6342-4651-90f1-c21f1505479d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:22:44.391467 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:44.392123 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:22:44.396500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-73a1d33d-5ebe-4464-b80b-0a23a9393d58 req-e47a26c4-d545-4b1c-bff3-55fc7bd929b0 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:44.396975 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-73a1d33d-5ebe-4464-b80b-0a23a9393d58 req-e47a26c4-d545-4b1c-bff3-55fc7bd929b0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:44.397408 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-73a1d33d-5ebe-4464-b80b-0a23a9393d58 req-e47a26c4-d545-4b1c-bff3-55fc7bd929b0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:44.408482 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-73a1d33d-5ebe-4464-b80b-0a23a9393d58 req-e47a26c4-d545-4b1c-bff3-55fc7bd929b0 service nova] Creating event network-vif-plugged:a4a63791-6342-4651-90f1-c21f1505479d for instance ea61be24-578a-4a3b-b3cc-11707f44787a on hv-cinder-74915 Sep 01 18:22:44.413498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-73a1d33d-5ebe-4464-b80b-0a23a9393d58 req-e47a26c4-d545-4b1c-bff3-55fc7bd929b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031822 Sep 01 18:22:44.414240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 580/1141] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:22:44.934197 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:44.934936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:44.941130 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:44.946417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:44.946417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:44.946417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:44.946417 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:44.946957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:45.075214 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:45.082687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3eb9d1c7-e945-46db-9e8b-8f98c4538009 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.153175 Sep 01 18:22:45.083241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 562/1142] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:44 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:46.105272 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:46.105961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:46.113029 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:46.113503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:46.113930 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:46.114606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:46.115062 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:46.115472 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:46.247752 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:46.255660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-32b40fb6-751b-4317-ad0b-9ba06eb319c6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1367 microversion: 2.1 time: 0.155174 Sep 01 18:22:46.256234 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 581/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:46 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:47.276842 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:47.277450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:47.283805 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:47.284277 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:47.284735 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:47.285416 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:47.285861 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:47.286279 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:47.420380 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:22:47.428225 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-db282246-c902-4f3d-90b4-25c2e51fa273 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1557 microversion: 2.1 time: 0.155205 Sep 01 18:22:47.428828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 563/1144] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:22:47 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:22:47.448961 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:22:47.449486 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:22:47.456034 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:47.456618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:47.457053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:47.457736 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:47.458186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:47.458606 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:47.538238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7aff5703-40c3-4467-93e7-7ac0f2489da4 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093220 Sep 01 18:22:47.538834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 582/1145] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:22:47 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:22:48.514808 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-2d0106e9-a80c-4b05-a22c-fd3aff486450 req-70ab2215-5c6f-4bde-924a-7391d9458e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea61be24-578a-4a3b-b3cc-11707f44787a", "tag": "a4a63791-6342-4651-90f1-c21f1505479d"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:22:48.524642 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d0106e9-a80c-4b05-a22c-fd3aff486450 req-70ab2215-5c6f-4bde-924a-7391d9458e8d service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:22:48.525114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d0106e9-a80c-4b05-a22c-fd3aff486450 req-70ab2215-5c6f-4bde-924a-7391d9458e8d service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:22:48.526049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-2d0106e9-a80c-4b05-a22c-fd3aff486450 req-70ab2215-5c6f-4bde-924a-7391d9458e8d service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:22:48.537309 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-2d0106e9-a80c-4b05-a22c-fd3aff486450 req-70ab2215-5c6f-4bde-924a-7391d9458e8d service nova] Creating event network-changed:a4a63791-6342-4651-90f1-c21f1505479d for instance ea61be24-578a-4a3b-b3cc-11707f44787a on hv-cinder-74915 Sep 01 18:22:48.543455 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-2d0106e9-a80c-4b05-a22c-fd3aff486450 req-70ab2215-5c6f-4bde-924a-7391d9458e8d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 Sep 01 18:22:48.544057 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 564/1146] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:03.623152 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:03.623910 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=44 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:03.625019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:24:03.625162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Thu Sep 1 18:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/ips (ip 10.222.0.15) !!! Sep 01 18:24:03.631092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:03.636020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:03.638031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:03.638505 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:03.638933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:03.639620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:03.640074 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:03.640527 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:03.665211 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b19d9ed2-24ef-4f42-9926-dec0f8cb214e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/ips" status: 200 len: 150 microversion: 2.1 time: 0.044279 Sep 01 18:24:03.665775 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 583/1147] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:24:03 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:03.677673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:03.678496 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=44 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:03.679755 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:24:03.679887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Thu Sep 1 18:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/os-volume_attachments (ip 10.222.0.15) !!! Sep 01 18:24:03.684320 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8f221ae-2c9b-4b8d-934c-1a5610eaf964"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:03.686667 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:03.694156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:03.694628 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:03.695054 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:03.695728 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:03.696169 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:03.696615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:03.968901 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Invalid volume: volume c8f221ae-2c9b-4b8d-934c-1a5610eaf964 is already attached to instances: c4ac1649-e139-4b5e-b08b-ea027725e50d Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: POST /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/os-volume_attachments HTTP/1.1 Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 74 Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:24:03.971094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {"volumeAttachment": {"volumeId": "c8f221ae-2c9b-4b8d-934c-1a5610eaf964"}} Sep 01 18:24:03.972939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Invalid volume: volume c8f221ae-2c9b-4b8d-934c-1a5610eaf964 is already attached to instances: c4ac1649-e139-4b5e-b08b-ea027725e50d Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'server_id': 'ea61be24-578a-4a3b-b3cc-11707f44787a', 'body': {'volumeAttachment': {'volumeId': 'c8f221ae-2c9b-4b8d-934c-1a5610eaf964'}}} Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c8f221ae-2c9b-4b8d-934c-1a5610eaf964 is already attached to instances: c4ac1649-e139-4b5e-b08b-ea027725e50d Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:24:03.974040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c8f221ae-2c9b-4b8d-934c-1a5610eaf964 is already attached to instances: c4ac1649-e139-4b5e-b08b-ea027725e50d Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:03.975697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c8f221ae-2c9b-4b8d-934c-1a5610eaf964 is already attached to instances: c4ac1649-e139-4b5e-b08b-ea027725e50d Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 400 to user: Invalid volume: volume c8f221ae-2c9b-4b8d-934c-1a5610eaf964 is already attached to instances: c4ac1649-e139-4b5e-b08b-ea027725e50d {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d261062e-065c-4354-9c43-168a8fd3a032 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.296816 Sep 01 18:24:03.977623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 565/1148] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:24:03 2022] POST /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a/os-volume_attachments => generated 174 bytes in 298 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:24:03.981717 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:03.982214 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:03.988546 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:03.989024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:03.989457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:03.990139 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:03.990588 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:03.991007 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:04.015755 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:24:04.362500 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b49ff143-b959-4fe3-889c-daa8e701c7a8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 204 len: 0 microversion: 2.1 time: 0.384866 Sep 01 18:24:04.363079 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 584/1149] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:24:03 2022] DELETE /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:24:04.377238 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:04.377843 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:04.383860 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:04.384371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:04.384809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:04.385488 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:04.385939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:04.386363 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:04.515203 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:04.522888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c0d69e33-e705-4785-9419-9c67b355e4ff tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1682 microversion: 2.1 time: 0.150370 Sep 01 18:24:04.523451 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 566/1150] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:04 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:05.545383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:05.546073 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:05.552669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:05.553210 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:05.553554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:05.554229 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:05.554676 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:05.555087 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:05.684355 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:05.692741 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fed9ee36-e7ee-48ce-96fe-ab1703c83071 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1682 microversion: 2.1 time: 0.151809 Sep 01 18:24:05.693298 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 585/1151] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:05 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:06.713828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:06.714424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:06.721640 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:06.722112 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:06.722535 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:06.723217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:06.723663 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:06.724081 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:06.811498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:06.820856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bcdcdf03-5524-48f1-9468-fe30249ad5a1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1614 microversion: 2.1 time: 0.110868 Sep 01 18:24:06.823010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 567/1152] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:06 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1614 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:07.079599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-0502f0b8-630a-43ba-81ca-b23691771226 req-be19eaa8-906d-4f14-9d82-735452d5acca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea61be24-578a-4a3b-b3cc-11707f44787a", "name": "network-vif-deleted", "tag": "a4a63791-6342-4651-90f1-c21f1505479d"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:07.089416 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-0502f0b8-630a-43ba-81ca-b23691771226 req-be19eaa8-906d-4f14-9d82-735452d5acca service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:07.089888 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-0502f0b8-630a-43ba-81ca-b23691771226 req-be19eaa8-906d-4f14-9d82-735452d5acca service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:07.090310 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-0502f0b8-630a-43ba-81ca-b23691771226 req-be19eaa8-906d-4f14-9d82-735452d5acca service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:07.101956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-0502f0b8-630a-43ba-81ca-b23691771226 req-be19eaa8-906d-4f14-9d82-735452d5acca service nova] Creating event network-vif-deleted:a4a63791-6342-4651-90f1-c21f1505479d for instance ea61be24-578a-4a3b-b3cc-11707f44787a on hv-cinder-74915 Sep 01 18:24:07.107192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-0502f0b8-630a-43ba-81ca-b23691771226 req-be19eaa8-906d-4f14-9d82-735452d5acca service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031858 Sep 01 18:24:07.107777 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 586/1153] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:07.842520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:07.843122 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:07.850239 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:07.850715 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:07.851144 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:07.851828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:07.852273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:07.852714 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:07.885333 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:07.885806 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:07.886229 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:07.886671 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lazy-loading 'fault' on Instance uuid ea61be24-578a-4a3b-b3cc-11707f44787a {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:24:07.929764 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:07.938044 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-aab9e0ff-f195-4c27-82bb-3923aad9d6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 200 len: 1331 microversion: 2.1 time: 0.099333 Sep 01 18:24:07.941862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 568/1154] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:07 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:08.961026 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:08.961745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:08.967859 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:08.968362 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:08.968796 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:08.969499 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:08.970067 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:08.970485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:08.983549 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a HTTP/1.1 Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:24:08.985680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:24:08.987378 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'ea61be24-578a-4a3b-b3cc-11707f44787a'} Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:24:08.988574 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:24:08.990181 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:08.991770 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:24:08.991770 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-49b2bdfd-bd4f-46a2-87ef-1b133aa20054 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 404 len: 111 microversion: 2.1 time: 0.030795 Sep 01 18:24:08.991770 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 587/1155] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:08 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:24:08.995949 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c20126aa-58d6-4f91-9fb2-cc92226a8b60 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '.version_select at 0x7f446ab1cb80>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:09.083011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c20126aa-58d6-4f91-9fb2-cc92226a8b60 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458625035" status: 202 len: 0 microversion: 2.1 time: 0.090896 Sep 01 18:24:09.083576 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 569/1156] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 1 18:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458625035 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:24:09.866620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:09.867119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:09.873169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:09.873654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:09.874091 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:09.874783 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:09.875237 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:09.876372 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:09.961560 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.objects.instance [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lazy-loading 'services' on Instance uuid c4ac1649-e139-4b5e-b08b-ea027725e50d {{(pid=121221) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:24:10.168810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6fcf1318-9ef2-4eaf-8a6f-047ccf2ecdb1 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments/c8f221ae-2c9b-4b8d-934c-1a5610eaf964" status: 202 len: 0 microversion: 2.1 time: 0.305759 Sep 01 18:24:10.169413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 588/1157] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:24:09 2022] DELETE /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments/c8f221ae-2c9b-4b8d-934c-1a5610eaf964 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:24:10.178427 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:10.180604 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:10.187705 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:10.188885 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:10.189523 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:10.190272 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:10.190722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:10.191141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:10.220012 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-900fbcb2-3a74-40c4-b2d6-16bf5f54a61a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045586 Sep 01 18:24:10.220588 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 570/1158] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:24:10 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:11.233366 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:11.235919 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:11.242430 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:11.251483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:11.251483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:11.251483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:11.251483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:11.251945 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:11.275826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2d77bf35-1ec3-47a2-9b84-2934cc97e869 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047150 Sep 01 18:24:11.276383 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 589/1159] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:24:11 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:12.287704 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:12.289865 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:12.296479 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:12.296953 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:12.298067 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:12.298837 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:12.299284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:12.299702 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:12.327369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-40cf4675-6c0e-4dd9-a714-192b58862485 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043640 Sep 01 18:24:12.327907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 571/1160] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:24:12 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 18:24:12.387665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:12.388175 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:12.394978 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:12.395455 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:12.395882 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:12.396583 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:12.397028 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:12.397443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:12.424472 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:24:12.700781 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2eec2e57-678c-416b-b6d6-4d200501a45f tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 204 len: 0 microversion: 2.1 time: 0.316576 Sep 01 18:24:12.701373 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 590/1161] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:24:12 2022] DELETE /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:24:12.710168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:12.710772 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:12.716683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:12.717156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:12.717579 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:12.718252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:12.718694 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:12.719159 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:12.849529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:12.857113 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3d961abe-de52-4eb8-ac26-fd9b7b0d5243 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1682 microversion: 2.1 time: 0.150829 Sep 01 18:24:12.857670 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 572/1162] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:12 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:13.878824 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:13.879509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:13.886053 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:13.886522 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:13.886947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:13.887620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:13.888056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:13.888501 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:14.018564 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:14.026092 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-2a376f50-b375-4d00-b03c-16c51a31ef2e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1682 microversion: 2.1 time: 0.151460 Sep 01 18:24:14.026647 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 591/1163] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:13 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:15.047914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:15.049533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:15.055537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:15.056075 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:15.056475 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:15.057168 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:15.057612 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:15.058036 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:15.208545 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:15.216232 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9e9d09c1-06c0-4040-aba2-8c6b61644c9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1682 microversion: 2.1 time: 0.173081 Sep 01 18:24:15.216819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 573/1164] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:15 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:15.788187 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-b5a490c9-2d15-4fdc-a444-8f2b43f67fa2 req-87c9b90d-ae7f-4c3c-946f-3d96cb6730d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4ac1649-e139-4b5e-b08b-ea027725e50d", "name": "network-vif-deleted", "tag": "9b228f76-04df-412d-87e7-960151bda1f2"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:15.799188 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b5a490c9-2d15-4fdc-a444-8f2b43f67fa2 req-87c9b90d-ae7f-4c3c-946f-3d96cb6730d4 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:15.799693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b5a490c9-2d15-4fdc-a444-8f2b43f67fa2 req-87c9b90d-ae7f-4c3c-946f-3d96cb6730d4 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:15.800119 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b5a490c9-2d15-4fdc-a444-8f2b43f67fa2 req-87c9b90d-ae7f-4c3c-946f-3d96cb6730d4 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:15.811401 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-b5a490c9-2d15-4fdc-a444-8f2b43f67fa2 req-87c9b90d-ae7f-4c3c-946f-3d96cb6730d4 service nova] Creating event network-vif-deleted:9b228f76-04df-412d-87e7-960151bda1f2 for instance c4ac1649-e139-4b5e-b08b-ea027725e50d on hv-cinder-74915 Sep 01 18:24:15.817663 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-b5a490c9-2d15-4fdc-a444-8f2b43f67fa2 req-87c9b90d-ae7f-4c3c-946f-3d96cb6730d4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033167 Sep 01 18:24:15.818488 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 592/1165] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:16.239855 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:16.240506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:16.246960 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:16.247442 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:16.247872 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:16.248803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:16.249563 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:16.250241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:16.286462 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:16.287060 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:16.287553 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:16.288461 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lazy-loading 'fault' on Instance uuid c4ac1649-e139-4b5e-b08b-ea027725e50d {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:24:16.330912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:16.338588 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c21105d2-c020-46a7-95bd-534f1f4264e8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 200 len: 1332 microversion: 2.1 time: 0.103018 Sep 01 18:24:16.339155 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 574/1166] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:16 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:17.360747 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:17.361432 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:17.368161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:17.368667 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:17.369098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:17.369803 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:17.370248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:17.370664 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:17.383492 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d HTTP/1.1 Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:24:17.385141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:24:17.386905 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'c4ac1649-e139-4b5e-b08b-ea027725e50d'} Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:24:17.387810 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:24:17.389255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:24:17.390466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:24:17.390466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9eea9fb4-b70e-4d97-9c51-e1df76fcb87d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 404 len: 111 microversion: 2.1 time: 0.030516 Sep 01 18:24:17.390466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 593/1167] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:17 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:24:17.395223 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-94710bc2-5a55-43de-ad02-b40bcbd3238a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '.version_select at 0x7f446a88a550>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:17.523102 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-94710bc2-5a55-43de-ad02-b40bcbd3238a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163117556" status: 202 len: 0 microversion: 2.1 time: 0.131531 Sep 01 18:24:17.523742 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 575/1168] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 1 18:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163117556 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:24:18.279996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-10f4747b-f7ac-4109-9e60-ce55ecffc156 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: .version_select at 0x7f446a81e790>, body: {"keypair": {"name": "tempest-keypair-1778075088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsIMJVoUPJOuz2AauF5b0bjhZr7n9uikPyKzAeuyRzK7laXMvFw4tGcDv+V8/iVhcEOGZ98MGQeNJYbsKkGgDJLmkUKsx5mnUFiq9yffKWGRklrsNqJfr64LPhLR3MjTQ=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:18.295412 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-10f4747b-f7ac-4109-9e60-ce55ecffc156 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:24:18.299242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-10f4747b-f7ac-4109-9e60-ce55ecffc156 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:24:18.391541 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-10f4747b-f7ac-4109-9e60-ce55ecffc156 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115358 Sep 01 18:24:18.392215 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 594/1169] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:24:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:24:20.469392 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-355954333", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c"}], "security_groups": [{"name": "tempest-securitygroup--1819230498"}], "key_name": "tempest-keypair-1778075088", "user_data": "}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:20.572846 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] validate_networks() for [('11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:24:21.052678 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:24:21.053094 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:24:21.053562 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:24:21.053967 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:24:21.054369 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:24:21.063006 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:21.063502 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:21.063957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:21.064699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:21.065142 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:21.065556 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:21.083125 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:24:21.086973 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:24:21.097774 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:24:21.100118 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:24:21.235542 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-21ae03f5-d517-4846-a09b-a1d91689fe44 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770901 Sep 01 18:24:21.236343 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 576/1170] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:24:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:24:21.247692 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-555cd113-ea72-4e0a-92c1-feda2cd4dd86 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:21.248291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-555cd113-ea72-4e0a-92c1-feda2cd4dd86 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:21.307113 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-555cd113-ea72-4e0a-92c1-feda2cd4dd86 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:21.313900 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-555cd113-ea72-4e0a-92c1-feda2cd4dd86 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1241 microversion: 2.1 time: 0.070642 Sep 01 18:24:21.314456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 595/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:21 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:22.335283 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:22.335900 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:22.342500 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:22.342976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:22.343408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:22.344102 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:22.344579 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:22.344999 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:22.407580 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:22.416068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-cf4f7cea-67eb-4b5e-bae5-3aef6e5c3be2 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1245 microversion: 2.1 time: 0.085231 Sep 01 18:24:22.416676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 577/1172] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:22 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:23.437065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:23.437675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:23.444258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:23.444870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:23.445307 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:23.446007 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:23.446456 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:23.446883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:23.519216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:23.523845 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-0e465406-b8b6-4d51-95cc-e222430faf61 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1301 microversion: 2.1 time: 0.090870 Sep 01 18:24:23.524443 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 596/1173] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:23 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:24.545554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:24.546157 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:24.553303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:24.553783 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:24.554217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:24.554913 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:24.555361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:24.555785 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:24.707219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:24.714868 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8567454a-db53-4241-b14b-4220c15bce37 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.173500 Sep 01 18:24:24.719548 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 578/1174] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:24 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:25.022083 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-b641cbe1-60f4-4df1-b68d-f4c1a59e782a req-0c713feb-9d5a-4611-b5d3-7b3319f82925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d2152f-c22b-4457-963e-66f05370bb7d", "tag": "b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:25.031915 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b641cbe1-60f4-4df1-b68d-f4c1a59e782a req-0c713feb-9d5a-4611-b5d3-7b3319f82925 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:25.032422 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b641cbe1-60f4-4df1-b68d-f4c1a59e782a req-0c713feb-9d5a-4611-b5d3-7b3319f82925 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:25.032852 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b641cbe1-60f4-4df1-b68d-f4c1a59e782a req-0c713feb-9d5a-4611-b5d3-7b3319f82925 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:25.045232 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-b641cbe1-60f4-4df1-b68d-f4c1a59e782a req-0c713feb-9d5a-4611-b5d3-7b3319f82925 service nova] Creating event network-changed:b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b for instance 59d2152f-c22b-4457-963e-66f05370bb7d on hv-cinder-74915 Sep 01 18:24:25.050163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-b641cbe1-60f4-4df1-b68d-f4c1a59e782a req-0c713feb-9d5a-4611-b5d3-7b3319f82925 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032657 Sep 01 18:24:25.050802 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 597/1175] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:25.736207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:25.736838 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:25.743889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:25.744465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:25.744949 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:25.745640 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:25.746084 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:25.746498 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:25.882330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:25.889990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c27a1236-6162-4545-9056-8810c4240ff3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.157697 Sep 01 18:24:25.891914 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 579/1176] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:25 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:26.912615 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:26.913314 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:26.919766 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:26.920241 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:26.920729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:26.921466 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:26.921915 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:26.922338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:27.052833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:27.060340 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-5eafaf24-c72d-4c39-ad8c-11bb4d2695c9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.153382 Sep 01 18:24:27.060900 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 598/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:26 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:28.081149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:28.081804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:28.088350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:28.088828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:28.089256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:28.089936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:28.090383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:28.090804 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:28.215990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:28.223912 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-dbfe73f8-3402-41d5-9356-331fc58126ea tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.146587 Sep 01 18:24:28.224487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 580/1178] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:28 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:29.244458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:29.245098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:29.251451 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:29.251940 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:29.252469 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:29.253179 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:29.253633 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:29.254754 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:29.387514 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:29.396326 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4e89b8c2-2f73-4273-ae52-527c94e8cb25 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.155885 Sep 01 18:24:29.396884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 599/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:29 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:30.417204 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:30.417814 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:30.424453 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:30.424925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:30.425350 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:30.426022 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:30.426463 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:30.426888 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:30.553948 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:30.560543 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-9ea5df94-0a57-4c13-b690-9a128764a6bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.147143 Sep 01 18:24:30.561109 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 581/1180] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:30 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:30.966368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-a6037256-140f-49db-aca0-e2bbc91bbfc6 req-ba618415-6908-4edb-a343-0e2643c1b3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d2152f-c22b-4457-963e-66f05370bb7d", "name": "network-vif-plugged", "status": "completed", "tag": "b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:30.975718 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a6037256-140f-49db-aca0-e2bbc91bbfc6 req-ba618415-6908-4edb-a343-0e2643c1b3b0 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:30.976203 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a6037256-140f-49db-aca0-e2bbc91bbfc6 req-ba618415-6908-4edb-a343-0e2643c1b3b0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:30.976676 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-a6037256-140f-49db-aca0-e2bbc91bbfc6 req-ba618415-6908-4edb-a343-0e2643c1b3b0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:30.987869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-a6037256-140f-49db-aca0-e2bbc91bbfc6 req-ba618415-6908-4edb-a343-0e2643c1b3b0 service nova] Creating event network-vif-plugged:b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b for instance 59d2152f-c22b-4457-963e-66f05370bb7d on hv-cinder-74915 Sep 01 18:24:30.992829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-a6037256-140f-49db-aca0-e2bbc91bbfc6 req-ba618415-6908-4edb-a343-0e2643c1b3b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089105 Sep 01 18:24:30.993415 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 600/1181] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:31.580823 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:31.581365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:31.583164 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:31.583821 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:31.589206 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:31.594217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:31.594217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:31.594217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:31.594217 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:31.594691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:31.718683 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:31.726181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-045291fe-90a1-4db7-bea9-ca3d20bf6fd3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.149279 Sep 01 18:24:31.726743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 582/1182] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:31 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:32.744471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:32.748997 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:32.760300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:32.760300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:32.760300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:32.760300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:32.760738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:32.760738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:32.760738 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:32.892287 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:32.895707 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:32.900979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a0398428-c1cf-423b-bd42-073da810d907 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1367 microversion: 2.1 time: 0.157549 Sep 01 18:24:32.901549 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 601/1183] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:32 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:33.921886 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:33.922521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:33.924819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:33.929409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:33.930107 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:33.930520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:33.931188 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:33.931632 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:33.932052 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:33.934581 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=97 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:34.063687 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:24:34.071711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ea7128bf-2158-4a2e-bdf2-3bfa06499ba7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1557 microversion: 2.1 time: 0.154102 Sep 01 18:24:34.072266 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 583/1184] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:24:33 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:24:34.092244 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:24:34.092787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:24:34.094971 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:24:34.099817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:34.100288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:34.100736 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:34.101413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:34.101964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:34.102393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:34.179507 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-20010ec2-ae19-423a-a63d-461881534656 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091321 Sep 01 18:24:34.180162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 602/1185] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:24:34 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:24:35.527662 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-38c68fa6-8f99-44ea-aecf-f5a863a8d140 req-88ed34a6-4304-4fb3-a13c-cb8ddf4d21ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d2152f-c22b-4457-963e-66f05370bb7d", "tag": "b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:24:35.537406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-38c68fa6-8f99-44ea-aecf-f5a863a8d140 req-88ed34a6-4304-4fb3-a13c-cb8ddf4d21ac service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:24:35.538711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-38c68fa6-8f99-44ea-aecf-f5a863a8d140 req-88ed34a6-4304-4fb3-a13c-cb8ddf4d21ac service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:24:35.538711 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-38c68fa6-8f99-44ea-aecf-f5a863a8d140 req-88ed34a6-4304-4fb3-a13c-cb8ddf4d21ac service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:24:35.553853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-38c68fa6-8f99-44ea-aecf-f5a863a8d140 req-88ed34a6-4304-4fb3-a13c-cb8ddf4d21ac service nova] Creating event network-changed:b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b for instance 59d2152f-c22b-4457-963e-66f05370bb7d on hv-cinder-74915 Sep 01 18:24:35.560450 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-38c68fa6-8f99-44ea-aecf-f5a863a8d140 req-88ed34a6-4304-4fb3-a13c-cb8ddf4d21ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096808 Sep 01 18:24:35.561264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 584/1186] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:25:50.464899 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:25:50.465483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Thu Sep 1 18:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/ips (ip 10.222.0.15) !!! Sep 01 18:25:50.520884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:25:50.526077 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:25:50.527342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:25:50.527820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:25:50.528255 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:25:50.528965 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:25:50.529413 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:25:50.529833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:25:50.553693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3c28381f-4455-44c0-b527-f7f1af436940 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/ips" status: 200 len: 150 microversion: 2.1 time: 0.091181 Sep 01 18:25:50.558088 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 603/1187] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:25:50 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:25:53.357065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:25:53.357852 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=7 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:25:53.363856 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b3ba4aa-16ea-4648-b66f-19e9cb01a085"}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:25:53.366248 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:25:53.372520 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:25:53.372998 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:25:53.373429 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:25:53.374116 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:25:53.374560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:25:53.374977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:25:54.353056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-a3305f69-fefc-42be-a736-806f72b650d8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.997879 Sep 01 18:25:54.353668 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 585/1188] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:25:53 2022] POST /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments => generated 194 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:26:01.876006 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b3ba4aa-16ea-4648-b66f-19e9cb01a085"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:26:01.878537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:01.880521 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:26:01.881903 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=8 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:26:01.886567 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:01.887043 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:01.887473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:01.888154 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:01.888623 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:01.889046 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:02.016890 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Invalid volume: volume 1b3ba4aa-16ea-4648-b66f-19e9cb01a085 is already attached to instances: 59d2152f-c22b-4457-963e-66f05370bb7d Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: POST /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments HTTP/1.1 Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 74 Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:26:02.027325 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {"volumeAttachment": {"volumeId": "1b3ba4aa-16ea-4648-b66f-19e9cb01a085"}} Sep 01 18:26:02.029483 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Invalid volume: volume 1b3ba4aa-16ea-4648-b66f-19e9cb01a085 is already attached to instances: 59d2152f-c22b-4457-963e-66f05370bb7d Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'server_id': '59d2152f-c22b-4457-963e-66f05370bb7d', 'body': {'volumeAttachment': {'volumeId': '1b3ba4aa-16ea-4648-b66f-19e9cb01a085'}}} Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1b3ba4aa-16ea-4648-b66f-19e9cb01a085 is already attached to instances: 59d2152f-c22b-4457-963e-66f05370bb7d Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:02.030536 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1b3ba4aa-16ea-4648-b66f-19e9cb01a085 is already attached to instances: 59d2152f-c22b-4457-963e-66f05370bb7d Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:26:02.032570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1b3ba4aa-16ea-4648-b66f-19e9cb01a085 is already attached to instances: 59d2152f-c22b-4457-963e-66f05370bb7d Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 400 to user: Invalid volume: volume 1b3ba4aa-16ea-4648-b66f-19e9cb01a085 is already attached to instances: 59d2152f-c22b-4457-963e-66f05370bb7d {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8e3b3ab7-605c-4c57-ab7b-40856fc43bca tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.148185 Sep 01 18:26:02.034291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 604/1189] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:26:01 2022] POST /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 18:26:02.086132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:02.086709 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:02.093365 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:02.093848 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:02.094273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:02.095014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:02.095537 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:02.095952 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:02.179957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lazy-loading 'services' on Instance uuid 59d2152f-c22b-4457-963e-66f05370bb7d {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:26:02.434596 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1de485b1-309b-4da1-8628-f1d00b49f496 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments/1b3ba4aa-16ea-4648-b66f-19e9cb01a085" status: 202 len: 0 microversion: 2.1 time: 0.353907 Sep 01 18:26:02.435227 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 586/1190] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:26:02 2022] DELETE /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments/1b3ba4aa-16ea-4648-b66f-19e9cb01a085 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:26:02.444524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:02.446651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:02.453602 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:02.454082 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:02.454512 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:02.455204 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:02.455646 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:02.456061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:02.485111 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f9485229-5efc-430f-b8ca-5b76597d931c tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045507 Sep 01 18:26:02.485655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 605/1191] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:26:02 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:26:03.498799 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:03.501123 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:03.507370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:03.507850 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:03.508845 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:03.509535 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:03.509980 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:03.510398 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:03.539818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-930e6554-8190-4368-8d4c-c22bcd517a04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046205 Sep 01 18:26:03.540393 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 587/1192] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:26:03 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:26:03.601497 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:03.602688 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:03.609112 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:03.609655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:03.610084 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:03.610761 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:03.611202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:03.611618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:03.636170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:26:03.974598 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-f472f5fa-109e-4bf7-85de-0f92ea4b23be tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 204 len: 0 microversion: 2.1 time: 0.376552 Sep 01 18:26:03.975182 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 606/1193] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:26:03 2022] DELETE /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:26:03.983314 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:03.983922 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:03.989877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:03.990380 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:03.990810 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:03.991495 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:03.991939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:03.992409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:04.118726 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:04.126333 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fa567326-7d85-49bd-88bb-e79a0bbe26f9 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1682 microversion: 2.1 time: 0.146886 Sep 01 18:26:04.126898 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 588/1194] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:03 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:05.148345 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:05.149660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:05.155901 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:05.156402 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:05.156833 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:05.157511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:05.157974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:05.158368 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:05.289035 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:05.297711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-8c0e5d55-3495-4e5d-8803-9d69aa3acdd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1682 microversion: 2.1 time: 0.153602 Sep 01 18:26:05.298271 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 607/1195] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:05 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:06.318946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:06.319510 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:06.326583 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:06.327053 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:06.327480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:06.328166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:06.328638 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:06.329406 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:06.524616 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:06.534792 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0121b92b-7dc3-446d-b801-fe0da1367f84 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1682 microversion: 2.1 time: 0.219676 Sep 01 18:26:06.535379 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 589/1196] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:06 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:07.273330 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-3987e153-4e22-4e57-81fc-8d52181eb85b req-4193e96a-0f68-45d0-bd8f-c68722782b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d2152f-c22b-4457-963e-66f05370bb7d", "name": "network-vif-deleted", "tag": "b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:26:07.286704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3987e153-4e22-4e57-81fc-8d52181eb85b req-4193e96a-0f68-45d0-bd8f-c68722782b44 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:07.287180 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3987e153-4e22-4e57-81fc-8d52181eb85b req-4193e96a-0f68-45d0-bd8f-c68722782b44 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:07.287607 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-3987e153-4e22-4e57-81fc-8d52181eb85b req-4193e96a-0f68-45d0-bd8f-c68722782b44 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:07.300991 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-3987e153-4e22-4e57-81fc-8d52181eb85b req-4193e96a-0f68-45d0-bd8f-c68722782b44 service nova] Creating event network-vif-deleted:b5b9f7c8-075c-4bf6-b13a-fe09432f7d8b for instance 59d2152f-c22b-4457-963e-66f05370bb7d on hv-cinder-74915 Sep 01 18:26:07.306671 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-3987e153-4e22-4e57-81fc-8d52181eb85b req-4193e96a-0f68-45d0-bd8f-c68722782b44 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094726 Sep 01 18:26:07.307613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 608/1197] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:26:07.557294 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:07.557942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:07.564626 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:07.565104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:07.565533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:07.566303 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:07.567459 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:07.567946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:07.600963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:07.601431 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:07.602531 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:07.602971 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lazy-loading 'fault' on Instance uuid 59d2152f-c22b-4457-963e-66f05370bb7d {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:26:07.646078 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:07.654985 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-41184396-d8ae-4532-91a9-642d448bff51 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 200 len: 1331 microversion: 2.1 time: 0.101887 Sep 01 18:26:07.655560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 590/1198] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:07 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:08.677111 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:08.677844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:08.684693 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:08.685170 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:08.685592 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:08.686261 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:08.686700 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:08.687113 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:08.700939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d HTTP/1.1 Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:26:08.702535 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:26:08.704248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '59d2152f-c22b-4457-963e-66f05370bb7d'} Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:26:08.705206 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:26:08.706675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:26:08.707925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:26:08.707925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-435b888d-e602-423b-b0aa-a97635153cf6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 404 len: 111 microversion: 2.1 time: 0.031439 Sep 01 18:26:08.707925 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 609/1199] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:08 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:26:08.713337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-191e21f5-5ef7-40ce-8f1a-2f2d4aa7d731 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '.version_select at 0x7f446aa5f670>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:08.801402 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-191e21f5-5ef7-40ce-8f1a-2f2d4aa7d731 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778075088" status: 202 len: 0 microversion: 2.1 time: 0.092357 Sep 01 18:26:08.801979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 591/1200] 10.222.0.15 () {58 vars in 1221 bytes} [Thu Sep 1 18:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778075088 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:26:09.543974 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1a5acb82-bb49-4a29-80ce-95712a5eab50 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: .version_select at 0x7f446a8f3790>, body: {"keypair": {"name": "tempest-keypair-372941375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDznujWIH/o2KIEkL5shloykdbKooHrulx78va1Y2M8Yvcj1DmTIqzzsBU2CJ6+tURmO52S0Kzx5yKOevLGFug25DrD8AbSuHwVprLBBOKdVwI4txN3SzRl3n0jXzC++Gg=="}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:26:09.559414 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-1a5acb82-bb49-4a29-80ce-95712a5eab50 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:26:09.563293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-1a5acb82-bb49-4a29-80ce-95712a5eab50 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'key_pairs'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:26:09.644024 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1a5acb82-bb49-4a29-80ce-95712a5eab50 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104522 Sep 01 18:26:09.644657 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 610/1201] 10.222.0.15 () {60 vars in 1159 bytes} [Thu Sep 1 18:26:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:26:11.953274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1026051660", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c"}], "security_groups": [{"name": "tempest-securitygroup--1649272247"}], "key_name": "tempest-keypair-372941375", "user_data": "}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:26:12.054010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] validate_networks() for [('11b23ebd-2e48-4797-9d0f-3b3c2f0e5b0c', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:26:12.417310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:26:12.418588 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:26:12.418588 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:26:12.418588 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:26:12.418957 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:26:12.427976 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:12.428486 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:12.428915 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:12.429654 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:12.430141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:12.430546 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:12.447567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:26:12.451527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Getting quotas for user 35b9e04e63bb43f9871bb8a3197adb5b and project f516c7aef4f244e3a388146bc2a522f4. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:26:12.463124 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:26:12.465409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:26:12.597010 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4d846a12-a333-4528-80b6-9b9c9863ecd8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648339 Sep 01 18:26:12.597570 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 592/1202] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:26:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:26:12.609265 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-133d9619-b490-41e8-a2c3-39527eceb6b3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:12.609872 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-133d9619-b490-41e8-a2c3-39527eceb6b3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:12.665538 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-133d9619-b490-41e8-a2c3-39527eceb6b3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:12.672568 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-133d9619-b490-41e8-a2c3-39527eceb6b3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1241 microversion: 2.1 time: 0.067848 Sep 01 18:26:12.673127 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 611/1203] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:12 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:13.693853 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:13.694608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:13.702014 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:13.702491 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:13.702929 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:13.703620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:13.704068 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:13.704527 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:13.768277 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:13.776732 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-236502b5-c51a-470f-8dc4-7480f19f1c10 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1245 microversion: 2.1 time: 0.087198 Sep 01 18:26:13.777296 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 593/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:13 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:14.797820 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:14.798429 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:14.805511 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:14.805994 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:14.806453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:14.807141 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:14.807590 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:14.808013 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:14.873680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:14.881446 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-16db038c-97c1-4736-ae57-ed43b50e9e67 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1293 microversion: 2.1 time: 0.087704 Sep 01 18:26:14.882018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 612/1205] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:14 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:15.902803 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:15.903522 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:15.910133 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:15.910712 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:15.911220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:15.911977 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:15.912538 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:15.913041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:16.127381 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:16.135040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d021f001-16e1-4520-bebb-28257de1342e tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.236237 Sep 01 18:26:16.135620 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 594/1206] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:15 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:16.536554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-2d0bd70f-9dae-405e-8b10-1a551f65c241 req-96325663-3988-44e7-9d88-6b634a3ff758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a698d0-78ec-4a17-a915-7b97464670c4", "tag": "621c857c-e4e0-435d-bb97-ee0aaa3a114e"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:26:16.546219 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2d0bd70f-9dae-405e-8b10-1a551f65c241 req-96325663-3988-44e7-9d88-6b634a3ff758 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:16.546697 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2d0bd70f-9dae-405e-8b10-1a551f65c241 req-96325663-3988-44e7-9d88-6b634a3ff758 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:16.547129 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-2d0bd70f-9dae-405e-8b10-1a551f65c241 req-96325663-3988-44e7-9d88-6b634a3ff758 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:16.558091 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-2d0bd70f-9dae-405e-8b10-1a551f65c241 req-96325663-3988-44e7-9d88-6b634a3ff758 service nova] Creating event network-changed:621c857c-e4e0-435d-bb97-ee0aaa3a114e for instance 08a698d0-78ec-4a17-a915-7b97464670c4 on hv-cinder-74915 Sep 01 18:26:16.563108 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-2d0bd70f-9dae-405e-8b10-1a551f65c241 req-96325663-3988-44e7-9d88-6b634a3ff758 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Sep 01 18:26:16.563687 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 613/1207] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:26:17.155132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:17.155675 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:17.162131 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:17.162603 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:17.163027 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:17.163706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:17.164180 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:17.164627 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:17.292706 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:17.300552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-4b97948b-566e-43fd-9528-fad7e7c072ab tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.149385 Sep 01 18:26:17.301113 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 595/1208] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:17 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:18.323314 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:18.324000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:18.330103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:18.330593 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:18.331012 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:18.331687 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:18.332133 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:18.332585 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:18.459160 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:18.467452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b3ff841c-efcf-43c3-8f0f-13274cdf15ad tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.149385 Sep 01 18:26:18.468018 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 614/1209] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:18 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:19.488019 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:19.488685 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:19.495566 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:19.496049 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:19.496525 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:19.497221 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:19.497674 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:19.498099 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:19.624494 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:19.632103 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5e9dd30c-a8db-432c-8ae8-9464f197dbd6 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.147964 Sep 01 18:26:19.632729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 596/1210] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:19 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:20.654019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:20.654763 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:20.661261 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:20.662674 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:20.662674 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:20.662884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:20.663299 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:20.664270 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:20.791393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:20.799246 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-575d64a1-a7ea-46ae-bbb6-503fd91299bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.150084 Sep 01 18:26:20.799803 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 615/1211] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:20 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:21.819127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:21.819654 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:21.826769 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:21.827253 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:21.827676 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:21.828391 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:21.828842 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:21.829262 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:21.968202 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:21.975887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-0b949c0a-980a-4785-94e0-92bd2b89c62d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.160727 Sep 01 18:26:21.976480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 597/1212] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:21 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:22.996674 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:22.997198 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:22.999608 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:26:23.004355 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:23.004830 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:23.005261 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:23.006046 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:23.006497 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:23.006913 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:23.138689 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:23.146153 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-3c646722-57c9-4c55-98c1-ec507200e55b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.153487 Sep 01 18:26:23.146704 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 616/1213] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:22 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:23.515830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-89756a49-32ce-427d-8bb1-619d2ff489da req-0109ddfe-da8b-40e6-8f1e-30ad7fc97ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a698d0-78ec-4a17-a915-7b97464670c4", "name": "network-vif-plugged", "status": "completed", "tag": "621c857c-e4e0-435d-bb97-ee0aaa3a114e"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:26:23.520966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:26:23.521615 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:26:23.522665 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:26:23.528065 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-89756a49-32ce-427d-8bb1-619d2ff489da req-0109ddfe-da8b-40e6-8f1e-30ad7fc97ddb service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:23.528550 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-89756a49-32ce-427d-8bb1-619d2ff489da req-0109ddfe-da8b-40e6-8f1e-30ad7fc97ddb service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:23.528996 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-89756a49-32ce-427d-8bb1-619d2ff489da req-0109ddfe-da8b-40e6-8f1e-30ad7fc97ddb service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:23.540121 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-89756a49-32ce-427d-8bb1-619d2ff489da req-0109ddfe-da8b-40e6-8f1e-30ad7fc97ddb service nova] Creating event network-vif-plugged:621c857c-e4e0-435d-bb97-ee0aaa3a114e for instance 08a698d0-78ec-4a17-a915-7b97464670c4 on hv-cinder-74915 Sep 01 18:26:23.545480 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-89756a49-32ce-427d-8bb1-619d2ff489da req-0109ddfe-da8b-40e6-8f1e-30ad7fc97ddb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033125 Sep 01 18:26:23.546095 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 598/1214] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:26:24.166947 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:24.167555 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:24.174152 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:24.174622 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:24.175048 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:24.175739 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:24.176166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:24.176604 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:24.302410 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:24.310061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c847fce9-8a21-4cd6-8417-06be75a0375d tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.147030 Sep 01 18:26:24.310614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 617/1215] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:24 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:25.332424 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:25.333114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:25.341061 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:25.341557 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:25.341985 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:25.342662 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:25.343104 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:25.343521 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:25.346120 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:26:25.475599 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:25.483743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-1717cc41-a9c7-4c25-ad10-2f08c6e290bd tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1367 microversion: 2.1 time: 0.156332 Sep 01 18:26:25.484560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 599/1216] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:25 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:26.504450 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:26.505112 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:26.511503 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:26.511979 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:26.512438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:26.513121 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:26.513569 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:26.513988 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:26.652069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:26:26.659734 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-fb4c38ab-29ae-42d7-b1bc-e1a9e9228f4a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1557 microversion: 2.1 time: 0.159219 Sep 01 18:26:26.660293 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 618/1217] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:26:26 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:26:26.681354 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:26:26.681910 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:26:26.688717 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:26.689194 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:26.689625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:26.690310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:26.690761 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:26.691179 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:26.769987 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-eaa5fa61-2f9b-428d-9c96-8abd87daa661 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093248 Sep 01 18:26:26.770902 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 600/1218] 10.222.0.15 () {58 vars in 1275 bytes} [Thu Sep 1 18:26:26 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:26:27.986333 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-1fa615a2-25ab-4d82-b325-f7e48a2f175a req-7e8cbe63-ac9c-4af3-b616-804adb121a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a698d0-78ec-4a17-a915-7b97464670c4", "tag": "621c857c-e4e0-435d-bb97-ee0aaa3a114e"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:26:27.997071 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-1fa615a2-25ab-4d82-b325-f7e48a2f175a req-7e8cbe63-ac9c-4af3-b616-804adb121a72 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:26:27.997670 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-1fa615a2-25ab-4d82-b325-f7e48a2f175a req-7e8cbe63-ac9c-4af3-b616-804adb121a72 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:26:27.998247 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-1fa615a2-25ab-4d82-b325-f7e48a2f175a req-7e8cbe63-ac9c-4af3-b616-804adb121a72 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:26:28.010085 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-1fa615a2-25ab-4d82-b325-f7e48a2f175a req-7e8cbe63-ac9c-4af3-b616-804adb121a72 service nova] Creating event network-changed:621c857c-e4e0-435d-bb97-ee0aaa3a114e for instance 08a698d0-78ec-4a17-a915-7b97464670c4 on hv-cinder-74915 Sep 01 18:26:28.015524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-1fa615a2-25ab-4d82-b325-f7e48a2f175a req-7e8cbe63-ac9c-4af3-b616-804adb121a72 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032806 Sep 01 18:26:28.016136 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 619/1219] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 18:27:40.737658 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=5 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:27:40.738408 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=9 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:27:40.743278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:40.743773 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:40.749907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:40.752776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:40.752776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:40.752776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:40.752776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:40.753187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:40.775549 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2eed014f-c215-4d02-849b-1678e941da9a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/ips" status: 200 len: 150 microversion: 2.1 time: 0.039693 Sep 01 18:27:40.779722 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 601/1220] 10.222.0.15 () {58 vars in 1248 bytes} [Thu Sep 1 18:27:40 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:27:42.453618 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:27:42.454355 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:27:42.459287 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c748a4fb-d5b9-4e75-9a61-bc7d41c9c6ff"}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:27:42.461713 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:42.468869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:42.469342 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:42.469767 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:42.470444 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:42.470883 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:42.471297 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:43.234186 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e45fbdab-5303-4b26-9697-098abea43950 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "POST /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782225 Sep 01 18:27:43.234986 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 620/1221] 10.222.0.15 () {60 vars in 1323 bytes} [Thu Sep 1 18:27:42 2022] POST /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:27:50.862558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:50.863071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:50.865384 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:27:50.870074 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:50.870551 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:50.870981 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:50.871661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:50.872854 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:50.883126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:50.955127 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lazy-loading 'services' on Instance uuid 08a698d0-78ec-4a17-a915-7b97464670c4 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:27:51.187584 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-806aeb97-b574-4543-b444-befd2e7748f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments/c748a4fb-d5b9-4e75-9a61-bc7d41c9c6ff" status: 202 len: 0 microversion: 2.1 time: 0.328997 Sep 01 18:27:51.188270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 602/1222] 10.222.0.15 () {58 vars in 1416 bytes} [Thu Sep 1 18:27:50 2022] DELETE /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments/c748a4fb-d5b9-4e75-9a61-bc7d41c9c6ff => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:27:51.198083 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:51.203600 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:51.207817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:51.208288 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:51.208750 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:51.209438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:51.209877 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:51.210290 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:51.240633 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7f5f0170-4675-4ccf-b11e-539ffc06f553 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Sep 01 18:27:51.241200 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 621/1223] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:27:51 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:27:52.254476 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:52.258089 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:52.264875 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:52.265383 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:52.265813 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:52.266511 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:52.266955 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:52.267370 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:52.297862 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c241081c-d271-4631-bb26-34817084c474 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047806 Sep 01 18:27:52.298423 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 603/1224] 10.222.0.15 () {58 vars in 1302 bytes} [Thu Sep 1 18:27:52 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 18:27:52.359973 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:52.360489 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:52.366809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:52.367280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:52.367702 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:52.368398 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:52.368841 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:52.369257 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:52.396124 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Going to try to terminate instance {{(pid=121221) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:27:52.741640 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6d70f0cf-e444-49a8-8371-92eaab11e7f3 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 204 len: 0 microversion: 2.1 time: 0.385073 Sep 01 18:27:52.742147 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 622/1225] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:27:52 2022] DELETE /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:27:52.751788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:52.752427 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:52.758540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:52.759017 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:52.759465 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:52.760138 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:52.760617 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:52.761041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:52.889951 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:27:52.897709 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-5307b7c6-0cfb-497c-85b4-8bfe98728b3b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1682 microversion: 2.1 time: 0.150886 Sep 01 18:27:52.898259 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 604/1226] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:27:52 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:27:53.919212 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:53.919896 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:53.926554 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:53.927020 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:53.927445 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:53.928113 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:53.928577 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:53.928991 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:54.056493 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:27:54.065061 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-a03b974a-fac4-4017-8dd0-11f9c02f5448 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1682 microversion: 2.1 time: 0.150114 Sep 01 18:27:54.065619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 623/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:27:53 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:27:55.086699 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:55.087313 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:55.098056 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:55.098560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:55.099002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:55.100624 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:55.101091 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:55.101639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:55.295432 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:27:55.303610 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-b6c9eb5a-13e8-47df-bc35-77ba6f9d9144 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1682 microversion: 2.1 time: 0.220798 Sep 01 18:27:55.304175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 605/1228] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:27:55 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:27:55.671442 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-b9b63539-585e-45a4-8951-3e592e46bfec req-43272513-22b9-4b3b-a6e9-0bcb0400dab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a698d0-78ec-4a17-a915-7b97464670c4", "name": "network-vif-deleted", "tag": "621c857c-e4e0-435d-bb97-ee0aaa3a114e"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:27:55.681758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b9b63539-585e-45a4-8951-3e592e46bfec req-43272513-22b9-4b3b-a6e9-0bcb0400dab7 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:55.682240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b9b63539-585e-45a4-8951-3e592e46bfec req-43272513-22b9-4b3b-a6e9-0bcb0400dab7 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:55.683683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-b9b63539-585e-45a4-8951-3e592e46bfec req-43272513-22b9-4b3b-a6e9-0bcb0400dab7 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:55.695596 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-b9b63539-585e-45a4-8951-3e592e46bfec req-43272513-22b9-4b3b-a6e9-0bcb0400dab7 service nova] Creating event network-vif-deleted:621c857c-e4e0-435d-bb97-ee0aaa3a114e for instance 08a698d0-78ec-4a17-a915-7b97464670c4 on hv-cinder-74915 Sep 01 18:27:55.700613 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-b9b63539-585e-45a4-8951-3e592e46bfec req-43272513-22b9-4b3b-a6e9-0bcb0400dab7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032732 Sep 01 18:27:55.701993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 624/1229] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:27:56.324582 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:56.325186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:56.332279 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:56.332809 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:56.333241 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:56.333946 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:56.334574 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:56.335212 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:56.369246 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:56.370077 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:56.370761 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:56.371218 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lazy-loading 'fault' on Instance uuid 08a698d0-78ec-4a17-a915-7b97464670c4 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:27:56.412666 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35b9e04e63bb43f9871bb8a3197adb5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516c7aef4f244e3a388146bc2a522f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:27:56.421188 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2e0359a5-d329-4e72-987d-2b3399b5f745 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 200 len: 1331 microversion: 2.1 time: 0.100441 Sep 01 18:27:56.431267 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 606/1230] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:27:56 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:27:57.444431 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:57.445122 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:57.451479 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:57.451953 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:57.452498 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:57.453192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:57.453643 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:57.454067 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:57.467320 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 HTTP/1.1 Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:27:57.468976 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:57.474369 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '08a698d0-78ec-4a17-a915-7b97464670c4'} Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:27:57.475390 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:57.477197 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:57.478743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:27:57.478743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1837a392-ee96-443d-a737-311989347466 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 404 len: 111 microversion: 2.1 time: 0.030712 Sep 01 18:27:57.478743 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 625/1231] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:27:57 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:27:57.479187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8ea6a50e-8b64-4726-97c0-a605af507708 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '.version_select at 0x7f446aab3790>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:57.540186 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8ea6a50e-8b64-4726-97c0-a605af507708 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372941375" status: 202 len: 0 microversion: 2.1 time: 0.064628 Sep 01 18:27:57.540749 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 607/1232] 10.222.0.15 () {58 vars in 1218 bytes} [Thu Sep 1 18:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372941375 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 18:27:59.676259 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:59.676823 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:59.683675 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:59.684162 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:59.684632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:59.685464 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:59.686196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:59.686628 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:59.700571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 HTTP/1.1 Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:27:59.702998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.704869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '08a698d0-78ec-4a17-a915-7b97464670c4'} Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:27:59.706044 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.707939 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.709696 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:27:59.709696 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-7bc1a8bc-83a2-4146-b24f-2729ee6508cc tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 404 len: 111 microversion: 2.1 time: 0.031967 Sep 01 18:27:59.709696 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 626/1233] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:27:59 2022] DELETE /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:27:59.713270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:27:59.713877 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 08a698d0-78ec-4a17-a915-7b97464670c4] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:27:59.721337 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:59.721816 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:59.722242 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:59.722918 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:27:59.723361 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:27:59.723776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:27:59.736704 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 HTTP/1.1 Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:27:59.738307 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.740005 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '08a698d0-78ec-4a17-a915-7b97464670c4'} Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:27:59.741185 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. Sep 01 18:27:59.742787 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:27:59.744270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance 08a698d0-78ec-4a17-a915-7b97464670c4 could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:27:59.744270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-6d5047cf-1a0d-4a43-b04d-e43b1134aec8 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4" status: 404 len: 111 microversion: 2.1 time: 0.030631 Sep 01 18:27:59.744270 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 608/1234] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:27:59 2022] GET /compute/v2.1/servers/08a698d0-78ec-4a17-a915-7b97464670c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:28:01.044926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:01.045452 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:01.052089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.052605 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.053036 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.053720 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.054167 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.054589 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.068236 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d HTTP/1.1 Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:28:01.069788 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.071563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '59d2152f-c22b-4457-963e-66f05370bb7d'} Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:28:01.072662 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.074347 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.076680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:28:01.076680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4ef15dd1-b6af-408c-bc16-f05fe7d3e4b7 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 404 len: 111 microversion: 2.1 time: 0.030100 Sep 01 18:28:01.076680 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 627/1235] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:28:01 2022] DELETE /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:28:01.079917 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:01.080558 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: 59d2152f-c22b-4457-963e-66f05370bb7d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:01.087284 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.087752 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.088184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.088889 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.089331 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.089745 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.103176 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d HTTP/1.1 Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:28:01.104729 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.106517 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': '59d2152f-c22b-4457-963e-66f05370bb7d'} Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:28:01.108082 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. Sep 01 18:28:01.109469 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.110863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance 59d2152f-c22b-4457-963e-66f05370bb7d could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:28:01.110863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-74ba5ed9-49e7-45bc-ab7c-d0e423b8c048 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d" status: 404 len: 111 microversion: 2.1 time: 0.030604 Sep 01 18:28:01.110863 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 609/1236] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:28:01 2022] GET /compute/v2.1/servers/59d2152f-c22b-4457-963e-66f05370bb7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:28:01.114838 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:01.115339 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:01.121248 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.121727 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.122161 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.123537 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.123993 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.124459 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.137620 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a HTTP/1.1 Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:28:01.139277 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.141049 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'ea61be24-578a-4a3b-b3cc-11707f44787a'} Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:28:01.142019 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.143599 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.145530 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:28:01.145530 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-bd427d30-10d0-4528-b4ce-96ace98c119a tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 404 len: 111 microversion: 2.1 time: 0.029643 Sep 01 18:28:01.145530 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 628/1237] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:28:01 2022] DELETE /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:28:01.152608 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:01.153220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: ea61be24-578a-4a3b-b3cc-11707f44787a] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:01.159220 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.159689 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.160118 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.160831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:01.161281 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:01.161831 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:01.175991 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a HTTP/1.1 Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:28:01.177533 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.179257 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'ea61be24-578a-4a3b-b3cc-11707f44787a'} Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:28:01.180646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. Sep 01 18:28:01.182395 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:01.184115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance ea61be24-578a-4a3b-b3cc-11707f44787a could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:28:01.184115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-20bed39e-d333-4df2-a172-1c2b5deaf33b tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a" status: 404 len: 111 microversion: 2.1 time: 0.030117 Sep 01 18:28:01.184115 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 610/1238] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:28:01 2022] GET /compute/v2.1/servers/ea61be24-578a-4a3b-b3cc-11707f44787a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:28:02.477291 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:02.477790 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:02.484614 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:02.485089 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:02.485524 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:02.486216 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:02.487665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:02.487665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:02.502172 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: DELETE /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d HTTP/1.1 Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:28:02.503726 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.505518 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': 'c4ac1649-e139-4b5e-b08b-ea027725e50d'} Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:28:02.506753 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.508457 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.510240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:28:02.510240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6293d6da-15a4-475f-9f95-c6cc8e674d04 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 404 len: 111 microversion: 2.1 time: 0.031662 Sep 01 18:28:02.510240 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 629/1239] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:28:02 2022] DELETE /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:28:02.514153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:02.524290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] [instance: c4ac1649-e139-4b5e-b08b-ea027725e50d] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:02.524290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:02.524290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:02.524290 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:02.524727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:02.524727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:02.524727 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:02.536817 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.wsgi [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] HTTP exception thrown: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Request method failure captured: Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: request: GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d HTTP/1.1 Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept: application/json Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Accept-Encoding: identity Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Connection: close Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Length: 0 Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Content-Type: application/json Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Host: 10.222.0.15 Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: Openstack-System-Scope: None Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: User-Agent: python-urllib3/1.26.12 Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Auth-Token: gAAAAABjEPf9OJ7x-VO0ysg3cAWQKCSMadpWEvlkcOOrSYcRhjG_LtjFta7L-2qtvwsDjSFiyY96hCYkgX1_fm76bhPfspMfiexABc-M2zZHD4TZsAS31Hg3l6T_khRut6qiOmJo2dJCqip0ZcMiTlPRFDD1g9CcwrNaG4exR-anEe4mzu2Jvy0 Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Id: None Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Domain-Name: None Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Identity-Status: Confirmed Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Is-Admin-Project: True Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Id: default Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Domain-Name: Default Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Project-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Role: member,reader Sep 01 18:28:02.538315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Roles: member,reader Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f516c7aef4f244e3a388146bc2a522f4", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f516c7aef4f244e3a388146bc2a522f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Id: f516c7aef4f244e3a388146bc2a522f4 Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-211740131 Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Id: default Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Domain-Name: Default Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Id: 35b9e04e63bb43f9871bb8a3197adb5b Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: X-User-Name: tempest-AttachVolumeNegativeTest-211740131-project Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: method: > Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: exception: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.540145 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: action_args: {'id': 'c4ac1649-e139-4b5e-b08b-ea027725e50d'} Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:28:02.541315 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. Sep 01 18:28:02.543032 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR nova.api.openstack.wsgi Sep 01 18:28:02.544605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] Returning 404 to user: Instance c4ac1649-e139-4b5e-b08b-ea027725e50d could not be found. {{(pid=121220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:28:02.544605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-8e05cf19-3268-47d9-bc64-ed6f1144f654 tempest-AttachVolumeNegativeTest-211740131 tempest-AttachVolumeNegativeTest-211740131-project] 10.222.0.15 "GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d" status: 404 len: 111 microversion: 2.1 time: 0.029939 Sep 01 18:28:02.544605 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 611/1240] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:28:02 2022] GET /compute/v2.1/servers/c4ac1649-e139-4b5e-b08b-ea027725e50d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:28:54.613223 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1548132737", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "networks": [{"uuid": "4b0b01e6-4315-4945-bacd-7e30f44d99a1"}]}} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:28:54.622485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:28:54.623143 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:28:54.670884 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.network.neutron [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] validate_networks() for [('4b0b01e6-4315-4945-bacd-7e30f44d99a1', None, None, None, None, None)] {{(pid=121221) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:28:55.065826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Flavor limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:28:55.066250 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Image limits 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:28:55.066721 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Flavor pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:28:55.067156 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Image pref 0:0:0 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:28:55.067563 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.virt.hardware [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121221) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:28:55.076290 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:55.076797 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:55.077228 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:55.077949 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:55.078396 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:55.078817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:55.095728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Getting quotas for project c1c4aa6faa6c4fe4b9724cbe693eae17. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:28:55.099787 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.quota [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Getting quotas for user 247bb18b75e149e58358ae36767265b3 and project c1c4aa6faa6c4fe4b9724cbe693eae17. Resources: {'ram', 'cores', 'instances'} {{(pid=121221) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:28:55.111213 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Going to run 1 instances... {{(pid=121221) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:28:55.113508 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121221) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:28:55.285471 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR oslo.messaging._drivers.impl_rabbit [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [9ba08c04-a62a-4eed-bf2f-d45be14360f9] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 18:28:56.293350 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [9ba08c04-a62a-4eed-bf2f-d45be14360f9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57176. Sep 01 18:28:56.298097 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-93272fd6-02b4-428b-a7a2-4bcbec75876d tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.688361 Sep 01 18:28:56.298870 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 630/1241] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:28:56.310274 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-141e646a-a8c4-4ae3-b003-5d689770a618 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:56.310883 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-141e646a-a8c4-4ae3-b003-5d689770a618 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:56.313219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:28:56.314029 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:28:56.371308 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-141e646a-a8c4-4ae3-b003-5d689770a618 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:28:56.379362 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-141e646a-a8c4-4ae3-b003-5d689770a618 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1214 microversion: 2.1 time: 0.072439 Sep 01 18:28:56.379894 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 612/1242] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:28:56 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:28:57.399468 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:57.400075 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:57.406963 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:57.407441 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:57.407916 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:57.408632 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:57.409108 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:57.409519 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:57.474809 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:28:57.483349 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-4b942ad5-9e0f-443f-afb5-d82d89cf9d37 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1218 microversion: 2.1 time: 0.088272 Sep 01 18:28:57.483922 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 631/1243] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:28:57 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:28:58.504724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:58.505321 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:58.516251 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:58.521887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:58.521887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:58.521887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:58.521887 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:58.522329 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:58.600963 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:28:58.610623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-3a5c4436-a5b5-4c5b-98c6-ed3e22a8cc17 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1274 microversion: 2.1 time: 0.109890 Sep 01 18:28:58.611205 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 613/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:28:58 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:28:59.631178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:28:59.631895 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:28:59.638729 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:59.639295 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:59.639846 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:59.640650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:28:59.641177 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:28:59.641758 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:28:59.790301 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:28:59.796960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-52357e97-d2ef-4438-82c8-a9ef06d32a3e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.169859 Sep 01 18:28:59.808725 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 632/1245] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:28:59 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:00.187835 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-7b5caf49-4376-4949-8a0e-58b4fd0387c7 req-f4f5f748-e8ca-4d1a-9401-c550c54cb4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e358426-caf6-42fd-960e-98f331b676d0", "tag": "4ddeece9-2fba-4599-8a2f-e839724a52a5"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:29:00.198148 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-7b5caf49-4376-4949-8a0e-58b4fd0387c7 req-f4f5f748-e8ca-4d1a-9401-c550c54cb4b5 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:00.198673 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-7b5caf49-4376-4949-8a0e-58b4fd0387c7 req-f4f5f748-e8ca-4d1a-9401-c550c54cb4b5 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:00.199132 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-7b5caf49-4376-4949-8a0e-58b4fd0387c7 req-f4f5f748-e8ca-4d1a-9401-c550c54cb4b5 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:00.211002 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-7b5caf49-4376-4949-8a0e-58b4fd0387c7 req-f4f5f748-e8ca-4d1a-9401-c550c54cb4b5 service nova] Creating event network-changed:4ddeece9-2fba-4599-8a2f-e839724a52a5 for instance 1e358426-caf6-42fd-960e-98f331b676d0 on hv-cinder-74915 Sep 01 18:29:00.216452 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-7b5caf49-4376-4949-8a0e-58b4fd0387c7 req-f4f5f748-e8ca-4d1a-9401-c550c54cb4b5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032786 Sep 01 18:29:00.217037 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 614/1246] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:29:00.818056 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:00.818655 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:00.825624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:00.826098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:00.826538 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:00.827208 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:00.827650 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:00.828066 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:00.956193 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:00.963815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-b8dfa826-cb59-48eb-97e7-bda29adb6beb tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.149665 Sep 01 18:29:00.967956 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 633/1247] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:00 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:01.986106 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:01.986798 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:01.992906 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:01.993387 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:01.993816 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:01.994503 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:01.994979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:01.995443 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:02.124114 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:02.131679 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-bf518ca1-ee73-4789-91ff-81ddc4f87833 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.150291 Sep 01 18:29:02.132261 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 615/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:01 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:03.152829 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:03.153420 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:03.160653 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:03.161137 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:03.161571 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:03.162258 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:03.162709 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:03.163131 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:03.291826 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:03.300429 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9f4f07f7-183a-40fe-984f-8572f4793549 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.151435 Sep 01 18:29:03.300998 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 634/1249] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:03 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:04.321210 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:04.321849 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:04.328660 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:04.329184 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:04.329570 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:04.330255 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:04.330703 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:04.331152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:04.574289 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:04.582172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-717a986b-bebc-42d2-a6e6-7d0df00508c7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.264778 Sep 01 18:29:04.582682 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 616/1250] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:04 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:05.603042 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:05.603570 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:05.605946 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:05.606864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=6 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:05.611694 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:05.612178 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:05.612636 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:05.613344 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:05.613791 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:05.614229 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:05.739146 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:05.746720 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-e73737dd-b87b-4bbd-a99a-08d426f6438e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.147651 Sep 01 18:29:05.747281 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 635/1251] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:05 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:06.295939 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-afc9bd56-62e6-4ee3-a3f3-90554f420c0e req-db002111-165d-473a-8b2d-8f1adaf68eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e358426-caf6-42fd-960e-98f331b676d0", "name": "network-vif-plugged", "status": "completed", "tag": "4ddeece9-2fba-4599-8a2f-e839724a52a5"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:29:06.306881 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-afc9bd56-62e6-4ee3-a3f3-90554f420c0e req-db002111-165d-473a-8b2d-8f1adaf68eda service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:06.307362 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-afc9bd56-62e6-4ee3-a3f3-90554f420c0e req-db002111-165d-473a-8b2d-8f1adaf68eda service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:06.307784 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-afc9bd56-62e6-4ee3-a3f3-90554f420c0e req-db002111-165d-473a-8b2d-8f1adaf68eda service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:06.319839 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-afc9bd56-62e6-4ee3-a3f3-90554f420c0e req-db002111-165d-473a-8b2d-8f1adaf68eda service nova] Creating event network-vif-plugged:4ddeece9-2fba-4599-8a2f-e839724a52a5 for instance 1e358426-caf6-42fd-960e-98f331b676d0 on hv-cinder-74915 Sep 01 18:29:06.325642 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-afc9bd56-62e6-4ee3-a3f3-90554f420c0e req-db002111-165d-473a-8b2d-8f1adaf68eda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033430 Sep 01 18:29:06.326232 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 617/1252] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:29:06.768032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:06.768660 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:06.774966 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:06.775440 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:06.775869 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:06.776581 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:06.777027 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:06.777473 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:06.908243 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:06.915933 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-ce55903d-68fb-41bf-9197-65694d6ce975 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.151858 Sep 01 18:29:06.916531 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 636/1253] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:06 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:07.934413 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:07.939011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:07.939697 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:07.945726 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:07.950140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:07.950140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:07.950140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:07.950140 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:07.950623 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:08.076219 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:08.083776 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-51bfafb2-1da9-4e01-8c51-a7b8ae525147 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1314 microversion: 2.1 time: 0.150474 Sep 01 18:29:08.084351 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 618/1254] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:07 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:09.104815 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:09.105423 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:09.112508 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:09.112987 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:09.113421 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:09.114106 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:09.114559 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:09.114980 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:09.244612 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:09.248098 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-00c65aa4-fbb0-4723-8921-3c26ba01d527 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1499 microversion: 2.1 time: 0.147126 Sep 01 18:29:09.249532 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 637/1255] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:09 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1499 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:10.054879 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:10.055371 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:10.062359 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:10.062830 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:10.063256 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:10.063936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:10.064409 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:10.064828 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:10.088925 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:29:10.335355 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d6002a84-7706-4be5-a80a-08727762e790 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 204 len: 0 microversion: 2.1 time: 0.283949 Sep 01 18:29:10.335943 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 619/1256] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:29:10 2022] DELETE /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:29:10.344328 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:10.344934 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:10.351580 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:10.352063 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:10.352530 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:10.353214 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:10.353745 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:10.354169 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:10.486084 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:10.493834 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-82fa62e9-bcd3-49b0-a7d3-098c8ad84d65 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1505 microversion: 2.1 time: 0.153615 Sep 01 18:29:10.494399 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 638/1257] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:10 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:11.515740 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:11.516378 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:11.522936 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:11.523441 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:11.523870 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:11.524619 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:11.525072 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:11.525496 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:11.655819 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:11.663540 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d2824ebd-b5a0-4077-8d89-91fabe5075d2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1505 microversion: 2.1 time: 0.152898 Sep 01 18:29:11.664156 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 620/1258] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:11 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:12.357651 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-5b8b6f80-446e-4298-aba2-f399322a0c8e req-be34a44b-9b75-456a-8685-a5e0a0d9d5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e358426-caf6-42fd-960e-98f331b676d0", "name": "network-vif-deleted", "tag": "4ddeece9-2fba-4599-8a2f-e839724a52a5"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:29:12.367377 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5b8b6f80-446e-4298-aba2-f399322a0c8e req-be34a44b-9b75-456a-8685-a5e0a0d9d5f2 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:12.367844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5b8b6f80-446e-4298-aba2-f399322a0c8e req-be34a44b-9b75-456a-8685-a5e0a0d9d5f2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:12.368268 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-5b8b6f80-446e-4298-aba2-f399322a0c8e req-be34a44b-9b75-456a-8685-a5e0a0d9d5f2 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:12.379485 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-5b8b6f80-446e-4298-aba2-f399322a0c8e req-be34a44b-9b75-456a-8685-a5e0a0d9d5f2 service nova] Creating event network-vif-deleted:4ddeece9-2fba-4599-8a2f-e839724a52a5 for instance 1e358426-caf6-42fd-960e-98f331b676d0 on hv-cinder-74915 Sep 01 18:29:12.384759 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-5b8b6f80-446e-4298-aba2-f399322a0c8e req-be34a44b-9b75-456a-8685-a5e0a0d9d5f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030882 Sep 01 18:29:12.385334 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 639/1259] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:29:12.685731 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:12.686451 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:12.693974 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:12.695039 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:12.695265 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:12.696150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:12.696753 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:12.697253 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:12.732066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:12.732577 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:12.733011 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:12.733454 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.objects.instance [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lazy-loading 'fault' on Instance uuid 1e358426-caf6-42fd-960e-98f331b676d0 {{(pid=121220) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 18:29:12.775884 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:12.784066 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-2ac0c690-ae21-4915-b116-64d06cb902ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 200 len: 1304 microversion: 2.1 time: 0.102807 Sep 01 18:29:12.784690 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 621/1260] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:12 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:13.806336 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:13.807041 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 1e358426-caf6-42fd-960e-98f331b676d0] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:13.813631 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:13.814103 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:13.814529 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:13.815202 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:13.815644 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:13.816058 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:13.829581 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] HTTP exception thrown: Instance 1e358426-caf6-42fd-960e-98f331b676d0 could not be found. Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Request method failure captured: Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 HTTP/1.1 Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPnkS2X-d1NBAqlSFQMsSjZC89KVkrRG3fPYR7sOw4LwIB4m1uFJrIjGWFEGX9hcYNRaoSDeQt7G-Xx3KzxvLNs7ys8SWDsM1BJSjC2lnJsZdlgJfv1LHhBlelA9V5wUpnmWLFmLa9VUpNXG2QA1S-EKetWVfJDNf5kEDaXsIHHCYVc Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: c1c4aa6faa6c4fe4b9724cbe693eae17 Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesActionsTest-1706013957 Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:29:13.831163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c1c4aa6faa6c4fe4b9724cbe693eae17", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1c4aa6faa6c4fe4b9724cbe693eae17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1c4aa6faa6c4fe4b9724cbe693eae17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c1c4aa6faa6c4fe4b9724cbe693eae17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesActionsTest-1706013957 Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: c1c4aa6faa6c4fe4b9724cbe693eae17 Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesActionsTest-1706013957 Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesActionsTest-1706013957-project Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 247bb18b75e149e58358ae36767265b3 Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesActionsTest-1706013957-project Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 1e358426-caf6-42fd-960e-98f331b676d0 could not be found. Sep 01 18:29:13.833015 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '1e358426-caf6-42fd-960e-98f331b676d0'} Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e358426-caf6-42fd-960e-98f331b676d0 could not be found. Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:29:13.834163 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e358426-caf6-42fd-960e-98f331b676d0 could not be found. Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e358426-caf6-42fd-960e-98f331b676d0 could not be found. Sep 01 18:29:13.835892 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:13.837686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Returning 404 to user: Instance 1e358426-caf6-42fd-960e-98f331b676d0 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:29:13.837686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-6b274c3f-3833-4863-88db-364f5f0b4eff tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0" status: 404 len: 111 microversion: 2.1 time: 0.030402 Sep 01 18:29:13.837686 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 640/1261] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:13 2022] GET /compute/v2.1/servers/1e358426-caf6-42fd-960e-98f331b676d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 18:29:13.881385 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-902468516", "imageRef": "a220e6f2-c503-47e5-83a9-ad0e705df277", "flavorRef": "452", "networks": [{"uuid": "4b0b01e6-4315-4945-bacd-7e30f44d99a1"}]}} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:29:13.933979 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.network.neutron [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] validate_networks() for [('4b0b01e6-4315-4945-bacd-7e30f44d99a1', None, None, None, None, None)] {{(pid=121220) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 18:29:14.284730 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Flavor limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 18:29:14.285152 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Image limits 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 18:29:14.285625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Flavor pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 18:29:14.286033 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Image pref 0:0:0 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 18:29:14.286438 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.virt.hardware [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121220) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 18:29:14.295374 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:14.295847 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:14.296278 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:14.297025 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:14.297476 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:14.298159 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:14.315149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Getting quotas for project c1c4aa6faa6c4fe4b9724cbe693eae17. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 18:29:14.319041 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.quota [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Getting quotas for user 247bb18b75e149e58358ae36767265b3 and project c1c4aa6faa6c4fe4b9724cbe693eae17. Resources: {'ram', 'cores', 'instances'} {{(pid=121220) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 18:29:14.330560 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Going to run 1 instances... {{(pid=121220) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 18:29:14.332866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a220e6f2-c503-47e5-83a9-ad0e705df277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121220) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 18:29:14.447231 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [6d9bd4af-8f18-4be9-9ae4-1e23de3abe11] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 18:29:15.464815 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [6d9bd4af-8f18-4be9-9ae4-1e23de3abe11] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57260. Sep 01 18:29:15.469669 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-fc0e615f-094c-41a3-a8b6-167d45e5ef95 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.592129 Sep 01 18:29:15.470319 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 622/1262] 10.222.0.15 () {60 vars in 1147 bytes} [Thu Sep 1 18:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 18:29:15.481035 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-d67fdc47-9c15-4efb-9304-bb1fca3e3fbd tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:15.481897 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-d67fdc47-9c15-4efb-9304-bb1fca3e3fbd tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:15.538626 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-d67fdc47-9c15-4efb-9304-bb1fca3e3fbd tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:15.545487 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-d67fdc47-9c15-4efb-9304-bb1fca3e3fbd tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1213 microversion: 2.1 time: 0.068211 Sep 01 18:29:15.546171 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 641/1263] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:15 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:16.566529 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:16.567166 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:16.573891 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:16.581966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:16.581966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:16.581966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:16.581966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:16.582372 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:16.648464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:16.657475 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c1c0b943-2195-4156-90fe-074fa57c6a14 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1217 microversion: 2.1 time: 0.095265 Sep 01 18:29:16.658129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 623/1264] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:16 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:17.679233 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:17.679864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:17.688619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:17.695711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:17.695711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:17.695711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:17.695711 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:17.696394 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:17.766148 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:17.774318 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-1abaf1ad-10e4-4f7b-ad87-6dc58cd153f6 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1273 microversion: 2.1 time: 0.098906 Sep 01 18:29:17.774903 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 642/1265] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:17 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:18.795147 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:18.796076 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:18.803088 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:18.803564 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:18.803990 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:18.804704 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:18.805150 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:18.805567 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:19.002661 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:19.010222 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-560957aa-6b66-4e7d-a217-0822cedfa141 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1313 microversion: 2.1 time: 0.219007 Sep 01 18:29:19.010781 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 624/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:18 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:19.433509 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-42af27f1-a6b2-4261-b323-ba570ccccc48 req-b9db576f-8a9b-4d48-b086-12aeec19f934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "630a633e-1f98-4832-bb81-4ab287a54a37", "tag": "0d3f8068-5a78-4cc2-9edf-0a7cf81e1ce8"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:29:19.442996 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-42af27f1-a6b2-4261-b323-ba570ccccc48 req-b9db576f-8a9b-4d48-b086-12aeec19f934 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:19.443462 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-42af27f1-a6b2-4261-b323-ba570ccccc48 req-b9db576f-8a9b-4d48-b086-12aeec19f934 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:19.443881 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-42af27f1-a6b2-4261-b323-ba570ccccc48 req-b9db576f-8a9b-4d48-b086-12aeec19f934 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:19.457821 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-42af27f1-a6b2-4261-b323-ba570ccccc48 req-b9db576f-8a9b-4d48-b086-12aeec19f934 service nova] Creating event network-changed:0d3f8068-5a78-4cc2-9edf-0a7cf81e1ce8 for instance 630a633e-1f98-4832-bb81-4ab287a54a37 on hv-cinder-74915 Sep 01 18:29:19.459960 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-42af27f1-a6b2-4261-b323-ba570ccccc48 req-b9db576f-8a9b-4d48-b086-12aeec19f934 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030218 Sep 01 18:29:19.460656 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 643/1267] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:29:20.032216 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:20.032688 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:20.038986 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:20.039474 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:20.039907 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:20.040629 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:20.041078 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:20.046691 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:20.191006 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:20.198893 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-ed9c797a-0c59-4ac5-9516-fec66f4e35f2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1313 microversion: 2.1 time: 0.171793 Sep 01 18:29:20.199464 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 625/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:20 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:21.221561 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:21.222245 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:21.228720 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:21.229196 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:21.229624 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:21.230329 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:21.230776 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:21.231191 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:21.359683 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:21.367274 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-9d1a3e33-bb24-4ee2-8c8f-d2786453e8ea tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1313 microversion: 2.1 time: 0.150904 Sep 01 18:29:21.368032 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 644/1269] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:21 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:22.387126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:22.387837 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:22.394554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:22.395036 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:22.395466 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:22.396153 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:22.396639 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:22.397059 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:22.528559 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:22.536710 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-91105a92-fd79-4205-ab0f-b7737947ebc2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1313 microversion: 2.1 time: 0.153586 Sep 01 18:29:22.537282 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 626/1270] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:22 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:23.558242 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:23.558771 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:23.561696 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 18:29:23.561827 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Thu Sep 1 18:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 (ip 10.222.0.15) !!! Sep 01 18:29:23.569000 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:23.569494 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:23.569926 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:23.570619 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:23.571067 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:23.571486 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:23.918844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:23.926617 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-c3cd73bd-4f77-4c3c-8234-8cabb6ce7aa7 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1313 microversion: 2.1 time: 0.372366 Sep 01 18:29:23.927179 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 645/1271] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:23 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:24.396028 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [req-cc4e4763-3641-48c0-93aa-cd2d8916b191 req-880e2af2-85ec-4b6e-a051-d66331239bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630a633e-1f98-4832-bb81-4ab287a54a37", "name": "network-vif-plugged", "status": "completed", "tag": "0d3f8068-5a78-4cc2-9edf-0a7cf81e1ce8"}]} {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:29:24.401611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=2 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:24.402273 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell0:SELECT=6 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:24.407757 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cc4e4763-3641-48c0-93aa-cd2d8916b191 req-880e2af2-85ec-4b6e-a051-d66331239bee service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:24.408234 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cc4e4763-3641-48c0-93aa-cd2d8916b191 req-880e2af2-85ec-4b6e-a051-d66331239bee service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:24.408695 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [req-cc4e4763-3641-48c0-93aa-cd2d8916b191 req-880e2af2-85ec-4b6e-a051-d66331239bee service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:24.419818 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.compute.server_external_events [req-cc4e4763-3641-48c0-93aa-cd2d8916b191 req-880e2af2-85ec-4b6e-a051-d66331239bee service nova] Creating event network-vif-plugged:0d3f8068-5a78-4cc2-9edf-0a7cf81e1ce8 for instance 630a633e-1f98-4832-bb81-4ab287a54a37 on hv-cinder-74915 Sep 01 18:29:24.425614 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [req-cc4e4763-3641-48c0-93aa-cd2d8916b191 req-880e2af2-85ec-4b6e-a051-d66331239bee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033347 Sep 01 18:29:24.426264 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 627/1272] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:29:24.947990 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:24.948608 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:24.950970 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:24.955860 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:24.956376 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:24.956817 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:24.957512 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:24.957964 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:24.958392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:24.961060 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell1:SELECT=75 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:25.087469 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:25.095669 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-44bc4713-5c7d-4c50-b700-87c4cabf405e tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1313 microversion: 2.1 time: 0.151507 Sep 01 18:29:25.096220 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 646/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:24 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:26.121187 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:26.121880 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:26.129743 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:26.130218 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:26.130646 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:26.131330 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:26.131780 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:26.132199 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:26.259552 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:26.267390 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-c3fe9aac-64d8-483b-bf33-0ed20ffeb541 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1313 microversion: 2.1 time: 0.150906 Sep 01 18:29:26.267952 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 628/1274] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:26 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:27.288453 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:27.289065 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:27.290906 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG dbcounter [-] [121221] Writing DB stats nova_cell0:SELECT=2 {{(pid=121221) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:27.297022 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:27.297526 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:27.298238 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:27.298931 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:27.299386 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:27.299811 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:27.431341 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:27.439768 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-093612f3-a208-4369-93f8-a7b4c180eaa2 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1498 microversion: 2.1 time: 0.155221 Sep 01 18:29:27.440346 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 647/1275] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:27 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:28.265009 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:28.265506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:28.271996 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:28.272506 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:28.272942 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:28.273622 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:28.274071 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:28.274487 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:28.299788 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Going to try to terminate instance {{(pid=121220) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 18:29:28.313966 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:28.521126 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG dbcounter [-] [121220] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121220) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 18:29:28.658565 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-d44c3798-07f7-4a0e-af83-09acd560b3f3 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "DELETE /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 204 len: 0 microversion: 2.1 time: 0.397392 Sep 01 18:29:28.659172 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 629/1276] 10.222.0.15 () {58 vars in 1239 bytes} [Thu Sep 1 18:29:28 2022] DELETE /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 18:29:28.667654 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:28.669230 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:28.675844 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:28.676338 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:28.676765 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:28.677438 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:28.677880 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:28.678294 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:28.806166 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.policy [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121221) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:28.813728 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-84609e3a-0bbe-4783-8b83-621731774561 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1504 microversion: 2.1 time: 0.150344 Sep 01 18:29:28.814280 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 648/1277] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:28 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:29.835554 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:29.836252 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:29.843141 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:29.843611 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:29.844040 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:29.844758 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:29.845207 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:29.845625 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:29.974792 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:29.983149 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-143568dd-d711-4ff2-bd1a-7557d4547def tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1504 microversion: 2.1 time: 0.151149 Sep 01 18:29:29.983724 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 630/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:29 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:30.813544 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [req-d7c85aa8-1a81-41ec-a2dd-130ca1981fd1 req-1f086ee5-ce1a-479c-a807-c3cacd28a1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "630a633e-1f98-4832-bb81-4ab287a54a37", "name": "network-vif-deleted", "tag": "0d3f8068-5a78-4cc2-9edf-0a7cf81e1ce8"}]} {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 18:29:30.823857 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d7c85aa8-1a81-41ec-a2dd-130ca1981fd1 req-1f086ee5-ce1a-479c-a807-c3cacd28a1b0 service nova] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:30.824300 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d7c85aa8-1a81-41ec-a2dd-130ca1981fd1 req-1f086ee5-ce1a-479c-a807-c3cacd28a1b0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:30.824751 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [req-d7c85aa8-1a81-41ec-a2dd-130ca1981fd1 req-1f086ee5-ce1a-479c-a807-c3cacd28a1b0 service nova] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:30.841902 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.compute.server_external_events [req-d7c85aa8-1a81-41ec-a2dd-130ca1981fd1 req-1f086ee5-ce1a-479c-a807-c3cacd28a1b0 service nova] Creating event network-vif-deleted:0d3f8068-5a78-4cc2-9edf-0a7cf81e1ce8 for instance 630a633e-1f98-4832-bb81-4ab287a54a37 on hv-cinder-74915 Sep 01 18:29:30.846806 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [req-d7c85aa8-1a81-41ec-a2dd-130ca1981fd1 req-1f086ee5-ce1a-479c-a807-c3cacd28a1b0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037473 Sep 01 18:29:30.847392 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 649/1279] 10.222.0.15 () {64 vars in 1317 bytes} [Thu Sep 1 18:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 18:29:31.005129 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.api.openstack.wsgi [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:31.005767 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.compute.api [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121220) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:31.012181 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:31.013514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:31.013514 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:31.014718 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:31.015175 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:31.015600 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG oslo_concurrency.lockutils [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121220) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:31.077866 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: DEBUG nova.policy [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bb18b75e149e58358ae36767265b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c4aa6faa6c4fe4b9724cbe693eae17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121220) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 18:29:31.085635 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: INFO nova.api.openstack.requestlog [None req-e698cfd9-df62-41dd-91cd-a066710346c5 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 200 len: 1298 microversion: 2.1 time: 0.084614 Sep 01 18:29:31.086310 dv-cinder-749155-10-iscsi devstack@n-api.service[121220]: [pid: 121220|app: 0|req: 631/1280] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:30 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 18:29:32.107644 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Calling method '>' {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 18:29:32.108335 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.compute.api [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] [instance: 630a633e-1f98-4832-bb81-4ab287a54a37] Fetching instance by UUID {{(pid=121221) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 18:29:32.114393 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:32.114864 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:32.115286 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:32.115962 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Acquiring lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 18:29:32.116458 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 18:29:32.116875 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG oslo_concurrency.lockutils [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Lock "b184ec90-bfcf-4d57-9534-1fd348f70a38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121221) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 18:29:32.130665 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.wsgi [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] HTTP exception thrown: Instance 630a633e-1f98-4832-bb81-4ab287a54a37 could not be found. Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Request method failure captured: Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: request: GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 HTTP/1.1 Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept: application/json Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Accept-Encoding: identity Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Connection: close Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Length: 0 Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Content-Type: application/json Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Host: 10.222.0.15 Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: Openstack-System-Scope: None Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: User-Agent: python-urllib3/1.26.12 Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Auth-Token: gAAAAABjEPnkS2X-d1NBAqlSFQMsSjZC89KVkrRG3fPYR7sOw4LwIB4m1uFJrIjGWFEGX9hcYNRaoSDeQt7G-Xx3KzxvLNs7ys8SWDsM1BJSjC2lnJsZdlgJfv1LHhBlelA9V5wUpnmWLFmLa9VUpNXG2QA1S-EKetWVfJDNf5kEDaXsIHHCYVc Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Id: None Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Domain-Name: None Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Identity-Status: Confirmed Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Is-Admin-Project: True Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Id: default Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Domain-Name: Default Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Id: c1c4aa6faa6c4fe4b9724cbe693eae17 Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Project-Name: tempest-VolumesActionsTest-1706013957 Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Role: member,reader Sep 01 18:29:32.132253 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Roles: member,reader Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_c1c4aa6faa6c4fe4b9724cbe693eae17", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1c4aa6faa6c4fe4b9724cbe693eae17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/c1c4aa6faa6c4fe4b9724cbe693eae17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/c1c4aa6faa6c4fe4b9724cbe693eae17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}] Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant: tempest-VolumesActionsTest-1706013957 Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Id: c1c4aa6faa6c4fe4b9724cbe693eae17 Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-Tenant-Name: tempest-VolumesActionsTest-1706013957 Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User: tempest-VolumesActionsTest-1706013957-project Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Id: default Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Domain-Name: Default Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Id: 247bb18b75e149e58358ae36767265b3 Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: X-User-Name: tempest-VolumesActionsTest-1706013957-project Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: method: > Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: exception: Instance 630a633e-1f98-4832-bb81-4ab287a54a37 could not be found. Sep 01 18:29:32.134069 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: action_args: {'id': '630a633e-1f98-4832-bb81-4ab287a54a37'} Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: {{(pid=121221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 630a633e-1f98-4832-bb81-4ab287a54a37 could not be found. Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 18:29:32.135192 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 630a633e-1f98-4832-bb81-4ab287a54a37 could not be found. Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 630a633e-1f98-4832-bb81-4ab287a54a37 could not be found. Sep 01 18:29:32.137031 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: ERROR nova.api.openstack.wsgi Sep 01 18:29:32.139426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: DEBUG nova.api.openstack.wsgi [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] Returning 404 to user: Instance 630a633e-1f98-4832-bb81-4ab287a54a37 could not be found. {{(pid=121221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 18:29:32.139426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: INFO nova.api.openstack.requestlog [None req-824593fc-6931-411b-924a-803c8e6ce6f8 tempest-VolumesActionsTest-1706013957 tempest-VolumesActionsTest-1706013957-project] 10.222.0.15 "GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37" status: 404 len: 111 microversion: 2.1 time: 0.030759 Sep 01 18:29:32.139426 dv-cinder-749155-10-iscsi devstack@n-api.service[121221]: [pid: 121221|app: 0|req: 650/1281] 10.222.0.15 () {58 vars in 1236 bytes} [Thu Sep 1 18:29:32 2022] GET /compute/v2.1/servers/630a633e-1f98-4832-bb81-4ab287a54a37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)